Innovar con la gestión ágil de proyectos, en PowToom :-)

1 Introducción a Scrum de ScrumStudy

Scrum a nivel mundial en el 2012 llegó a la mayoría temprana

Sabías que SCRUM es el modelo de gestión de proyectos ágil,  más usado en el mundo desde el año 2012 -Gartner Group? Ya se usa más que el PMBOK de PMI en la mediana empresa y proyectos complejos.

Curva de adopción de la innovación muestra como las nuevas ideas , productos y metodologías llegan al mercado objetivo. Innovadores y visionarios son los lideres que guían el camino hacia el futuro. Los mayoría temprana esta conformada por los investigadores y apasionados por el conocimiento y la mejora continua .

Scrum a nivel mundial en el 2012 llegó a la mayoría temprana.

En colombia puedes ser un visionario certificandose como Scrum Master SMC de Scrumstudy. Certificación Internacional SMC de Scrumstudy en Medellin y Manizales  http://opensourcepyme.com/certificacion-smc/  

fuente : https://www.linkedin.com/pulse/scrum-nivel-mundial-en-el-2012-lleg%C3%B3-la-mayor%C3%ADa-jorge-r

1 Introducción a Scrum de ScrumStudy

ETL Open Source :-)

Estas herramientas de ETL Extraccion Trasformacion y Carga, permiten modelar los datos y que sirvan para analiticas y BI

11 Great ETL Tools

1. Apache Camel is an open source Java integration framework that enables integration of different applications using multiple protocols and technologies. It is a rule-based routing and mediation engine. To configure routing and mediation rules, it provides Java object-based implementation of Enterprise Integration Patterns (EIP), using an API or declarative Java domain-specific language. EIPs are design patterns that enable the use of enterprise application integration and message-oriented middleware. Apache Camel uses Uniform Resource Identifiers (URIs), a naming scheme used in Camel to refer to an endpoint that provides information such as which components are being used, the context path and the options applied against the component. There are more than 100 components used by Apache Camel, including FTP, JMX and HTTP. Apache Camel can be deployed as a standalone application in a web container such as Tomcat, a JEEE application server such as JBOSS AS, or in combination with a Spring container.
2. Apache Kafka is an open source platform written in Scala and Java. It provides a unified, high-throughput, low-latency platform for managing real-time data. Kafka publishes and subscribes to a stream of records in a fault-tolerant way, immediately as they occur.Nodes of a Kafka cluster are known as brokers; streams of records stored in a cluster are known as topics; and each record consists of a key, value and timestamp. Kafka can be used in many different ways; for example as a message bus, a buffer for replication systems or event processing, and to decouple apps from databases for both OLTP and DWH.
3. Apatar is an open source data integration and ETL tool, with capabilities for extracting, transforming and loading data. Apatar comes with a visual interface that can reduce R&D costs, improve data integration efficiency and minimize the impact of system changes. Apatar is written in Java and has Unicode-compliant functionality. It can be used to integrate data across teams, populate data warehouses and data marts, and schedule and maintain little or no code when connected to other systems.
4. Atom, from ironSource, is a data pipeline management solution that allows data streaming in near real time, into a data warehouse. Atom enables data flow customization, based on requirements that help manage data more efficiently. Atom’s transformation code is written in Python, which helps turn raw logs into queryable fields and insights. It provides a collection layer, which supports sending data from any source and in any format to arrive to the target data repository near real time. Atom also has pause and play options. A reliable resumption of data flow without losing a single event is an important capability of Atom, in terms of maintaining data integrity.
5. Fivetran is a fully-managed data pipeline that integrates data from SaaS services and databases into a single data warehouse. It provides direct integration and sends data over a direct secure connection using a sophisticated caching layer. This caching layer helps to move data from one point to another without ever storing a copy on the application server. Fivetran does not impose any data limit, and can be used to centralize a company’s data and integrate all sources to determine Key Performance Indicators (KPIs) across an entire organization.
6. Heka is an open source software system for high performance data gathering, analysis, monitoring and reporting. Its main component is a daemon program known as ‘hekad’ that enables the functionality of gathering, converting, evaluating, processing and delivering data. Heka is written in the ‘Go’ programming language, and has built-in plugins for inputting, decoding, filtering, encoding and outputting data. These plugins have different functionalities and can be used together to build a complete pipeline. Heka uses Advanced Message Queuing Protocol (AMQP) or TCP to ship data from one location to another. It can be used to load and parse log files from a file system, or to perform real-time analysis, graphing and anomaly detection on any type of data flow.
7. Logstash is an open source data processing pipeline that ingests data from multiple sources simultaneously, transforming the source data and store events into ElasticSearch by default. Logstash is part of an ELK stack. The E stands for Elasticsearch, a JSON-based search and analytics engine, and the K stands for Kibana, which enables data visualization. Logstash is written in Ruby and provides a JSON-like structure which has a clear separation between internal objects. It has a pluggable framework featuring over 200 plugins, enabling the ability to mix, match and orchestrate facilities over different input, filters and output. This tool can be used for BI, or in data warehouses with fetch, transformation and storing event capabilities.
8. Scriptella is an open source ETL and script execution tool capable of using SQL or any other scripting language to perform data transformations. Scriptella supports cross-database ETL scripts, and can work with multiple data sources in a single ETL file. Scriptella integrates with any JDBC/ODBC compliant driver, and provides an interface that allows interoperability with non-JDBC data sources and scripting languages. It can also integrate with Java EE, Spring, JMX, JNDI and JavaMail.
9. Segment is a platform for collecting customer data and then sending it to analytics, marketing and data warehousing services. It provides an API that supports collection and routes of customer data to over 180 different tools and database services. Segment’s API has native library sources for every language, and helps record customer data from sources such as websites, mobile, apps or servers. It helps optimize analytics by piping raw customer data into data warehouses for further exploration and advanced analysis. The API can be used to query data or optimize marketing performance and design.
10. Stitch is a self-service ETL data pipeline solution built for developers. The Stitch API can replicate data from any source, and handle bulk and incremental data updates. Stitch also provides a replication engine that relies on multiple strategies to deliver data to users. Its REST API supports JSON or transit, which helps enable automatic detection and normalization of nested document structures into relational schemas. Stitch can connect to Amazon Redshift, Google BigQuery, and Postgres - and integrates with BI tools. Stitch is typically designed to collect, transform and load Google analytics data into its own system, to automatically give business insights on raw data.
11. Talend open source data integration software products provide tools to integrate, cleanse, mask and profile data. Talend has a GUI that enables managing a large number of source systems using standard connectors. It also has Master Data Management (MDM) functionality, which allows organizations to have a single, consistent and accurate view of key enterprise data. This can create better transparency across a business, and lead to better operational efficiency, marketing effectiveness and compliance.

fuente : https://dzone.com/articles/11-great-etl-tools-and-the-case-for-saying-no-to-e?edition=269882&utm_source=Spotlight&utm_medium=email&utm_campaign=big%20data%202017-02-16

Ubuntu 16, configurar unidad windows 8 y windows 10

Cuando se instala con Windows 8 o windows 10, normalmente detecta la particiones de windows y las monta automaticamente.
El algunos casos aparece un error :-) como  imagen

Unable to access “ windows GB Volume”
Error mounting /dev/sda3 at /media/jaristizabal/965A89A65A898429: Command-line `mount -t "ntfs" -o "uhelper=udisks2,nodev,nosuid,uid=1000,gid=1000" "/dev/sda2" "/media/jaristizabal/965A89A65A898429"' exited with non-zero exit status 14: Windows is hibernated, refused to mount.
Failed to mount '/dev/sda2': Operation not permitted
The NTFS partition is in an unsafe state. Please resume and shutdown
Windows fully (no hibernation or fast restarting), or mount the volume
read-only with the 'ro' mount option.

SOLUCION :-)
Tu solución es más segura (ya que quién mejor conoce como funciona NTFS es Windows), pero desde Linux se puede intentar, si es que no se dispone de un CD/USB con Windows, lo siguiente:

sudo ntfsfix -d /dev/sdXX

/dev/sdXX es donde se encuentra instalado Windows.

Si corrigio el problema aparece un mensaje

 NTFS partition /dev/sda3 was processed successfully

Existe un problema con el inicio rapido de windows

Buscando por la web descubrí que esto se debe a que Windows 10 no hace un apagado total del sistema (Algo similar en un problema cuando usaba Windows 8) sino que mete al sistema en una especie de hibernación (por esto el mensaje que les decía al principio del post) para que su inicio sea relativamente más rápido, lo hacen llamar “fastboot” (booteo rápido). Esto hace que el disco al que quiero acceder, al ser una partición NTFS que comparten los dos Sistemas Operativos cuando uso Windows 10 lo deja en un estado en el que es imposible leerlo. Claro, ustedes me dirán que puedo accederlo igual si toco las configuraciones, si, esto es cierto, pero esto puede hacer que genere problemas grandes ya que Windows 10 deja al disco en un estado al que podríamos llamarlo “de cerrado incompleto” entonces cuando se va a querer acceder desde Windoes 10 y quiere retomar este estado podemos romper el disco si lo tocamos desde Linux.

Pero tranquilos, la solución existe y es sumamente fácil. Son 6 pasos sencillos que debemos realizarlos desde Windows 10:

1. Abrimos el Panel de Control y vamos a Sistema y Seguridad.

2. Vamos a "Opciones de Energía"

3. Despues al apartado “Elegir la acción de los botones de inicio/apagado”.

4. Hacemos click en Cambiar la configuración no disponible actualmente. Esto hará que la parte gris de la configuración se habilite.

5. Desactivamos la opción “Activar inicio rápido (recomendado)”. Este es el famoso “fast boot” de Windows 10.

Con estos pasos hechos veremos que no vamos a tener problemas en acceder a nuestra partición NTFS en Linux ya que Windows 10 hará el apagado completo del equipo, por ende, el cierre de estado correcto para los discos.
Esto mas que nada parece un tutorial de Windows, pero si tienen el mismo problema esto es la solución más rápida. Claro que con esto sacrificamos el “inicio rápido” de Windows 10, pero vamos, prefiero un sistema estable y accesible a uno que inicie un poco más rápido.

fuente: https://javaheros.blogspot.com.co/2016/02/solucion-montar-disco-o-particion-de.html

Copias de datos Backup

todos necesitamos tener copias de los datos y a principio de año , guardar la historia es importante
Aqui dejo 3 opciones muy buenas

Fuente https://sourceforge.net

http://blog.bacula.org/

The Bacula® Open Source Network Backup Solution

Bacula is a set of Open Source, computer programs that permit you (or the system administrator) to manage backup, recovery, and verification of computer data across a network of computers of different kinds. Bacula is relatively easy to use and very efficient, while offering many advanced storage management features that make it easy to find and recover lost or damaged files. In technical terms, it is an Open Source, network based backup program.
According to Source Forge statistics (rank and downloads), Bacula is by far the most popular Open Source backup program.

http://www.areca-backup.org/features.php
Backup Engine Features :

• Archives compression (Zip & Zip64 format)
• Archives encryption (AES128 & AES256 encryption algorithms)
• Storage on local hard drive, network drive, USB key, FTP, FTPs (with implicit and explicit SSL / TLS) or SFTP server
• Source file filters (by extension, subdirectory, regular expression, size, date, status, with AND/OR/NOT logical operators)
• Incremental, differential and full backup support
• Support for delta backup (store only modified parts of your files)
• Archives merges : You can merge contiguous archives into one single archive to save storage space.
• As of date recovery : Areca allows you to recover your archives (or single files) as of a specific date.
• Transaction mechanism : All critical processes (such as backups or merges) are transactional. This guarantees your backups' integrity.
• Backup reports : Areca generates backup reports that can be stored on your disk or sent by email.
• Post backup scripts : Areca can launch shell scripts after backup.
• Files permissions, symbolic links and named pipes can be stored and recovered. (Linux only)

Graphical User Interface :

• Archives content explorer. (including a 'find file in archives' feature)
• Archive description : A manifest is associated to each archive, which contains various informations such as title, date, description, and additional technical data.
• File version tracking : Areca keeps track of your files' history (creation / modifications / deletion). Each version can be selectively viewed and recovered.
• Backup simulation (check whether a backup is necessary)
• User's actions history : Areca keeps an history of all user's actions (archives deletion, merges, backups, recoveries).

Command-Line Interface :

• Areca comes with a command-line interface which can be used for backup automation.

FreeFileSync

Free backup software to synchronize files and folders

http://www.freefilesync.org/