Latest news

Java Backend Developer for Big Data

Job Opportunity Java Backend Developer for Big Data Xpand IT

Java Backend Developer for Big Data

Complex problems require the right expertise! Today one of the biggest challenges is data storage and processing, cross these three main domains (3Vs): Volume, Velocity and Variety.

At Xpand IT, the Big Data technological area develops and implements architectures and software solutions that represent the state of the art on the capture, ingestions, storage and management of critical data from huge clusters where the 3Vs are always present. In what concerns to technology stack, we take advantage of almost all state-of-the-art frameworks in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services or MongoDB using Java and Scala as programming language to interact with them.

YOUR ROLE

As a Java Backend Developer for Big Data you’ll play a key role in the team along with Big Data System Engineers to create the best software solutions applying big data best practices in terms of architecture and systems design. You’ll guarantee backend software performance, reliability and scalability is achieved independently of how fast data clusters grow or the throughput of information increases.

Your daily activities will include:

  • Implement software solutions that include loading, preprocessing and ingestion from disparate data sets into big data clusters.
  • Design robust and reliable software solutions independently of amount of input data.
  • Implement big data industry standards into the final software solution
  • Analyse complex problems that need solutions for efficiently manipulate huge amounts of information
  • Develop data models and data organizations that optimize “search” and “store” operations in large sale distributed systems
  • Design APIs for swift data tracking and query data at high speeds

// Stacks: Java; Scala; HDFS, Hive, Impala, Spark, Kafka/Confluent; MongoDB, HBase

Java Backend Developer for Big Data Apache Spark
Java Backend Developer for Big Data Confluent
Java Backend Developer for Big Data Kafka
Java Backend Developer for Big Data MongoDB
Java Backend Developer for Big Data HBase
Java Backend Developer for Big Data Cassandra
Java Backend Developer for Big Data Hive
Java Backend Developer for Big Data Scala

SKILLS YOU NEED TO HAVE

  • MSc / BSc in Information Systems and Computer Engineering and/or Computer Science
  • Strong knowledge on Linux operating systems
  • Experience with Java oriented technologies (JBoss, Spring, Spring MVC, Hibernate, REST/SOAP)
  • Experience of design patterns to implement advanced software solutions.
  • Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.)
  • Strong experience in using Eclipse, Maven, Jenkins, GIT, JIRA or equivalent tools
  • Strong communication skills (written and spoken).

// Will be a nice plus if you have: 

  • Knowledge or experience with Apache Spark, Kafka or the Hadoop ecosystem
  • Team player and problem solving skills

// Learn more about Big Data area:

Apply here

Being a Big Data Software Engineer at Xpand IT means satisfying the highly demanding data flow needs of today. We create and build scalable technological solutions using the best tools available. In such a fast-evolving sector we are challenged to work with new technologies and being able to share that experience with a highly skilled team is fascinating.

Guilherme Andrade, Big Data Software Engineer @Xpand IT
Job Opportunity Java Backend Developer for Big Data Xpand IT

Videos that tell you the whole story

Xpand IT: You Have to Live it!

Summer Trip

Be an Xpander

Life at Xpand IT

XTech Community

Meetup

Sara GodinhoJava Backend Developer for Big Data
read more

Big Data CloudOps Engineer

Job Opportunity Big Data CloudOps Engineer Xpand IT

Big Data CloudOps Engineer

Complex problems require the right expertise! Today one of the biggest challenges is data storage and processing, across these three main domains (3Vs): Volume, Velocity and Variety.

At Xpand IT, the Big Data technological area develops and implements architectures and software solutions that represent the state of the art on the capture, ingestions, process, enrich, storage and management of critical data from huge clusters where the 3Vs are always present. In what concerns to technology stack, we take advantage of almost all state-of-the-art frameworks in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services, MongoDB using Java and Scala as programming language to interact with them.

YOUR ROLE

As a Big Data CloudOps Engineer you’ll play a fundamental role in several phases of the adoption of Big Data platform in Cloud context (Azure or AWS),  participating in the analysis, definition and sizing of distributed storage and / or computing systems, setup, upgrade, securization and tuning. For these critical systems, a special focus on performance and security is crucial, as well as implementing the best service development practices to serve as the basis for monitoring tools.

Usually this role also works closely with the development teams in the design, development and installation of application solutions, processing and storage of large-scale data.

Your daily activities will include:

  • Setup / upgrade / securization / tuning of platforms on a large scale in critical, ephemeral and / or self-scaling environments on a Cloud provider
  • Implement security rules and policies on Cloud platforms
  • Recommend and periodically update the best practices for using Cloud services
  • Configure good practices for monitoring the infrastructure
  • Analyze sizing requirements and ideal services for each project to be implemented
  • Design and develop new processes for better stability and performance maintenance of environments
  • Develop integration or automation processes for Cloud deployments. Being able to resort to containerized environments on Kubernetes
  • Participate and help solve performance, scalability and security issues

// Stacks: Cloudera, Confluent, Azure Data Services, MongoDB, Kerberos ou Windows Active Directory

Big Data CloudOps Engineer Xpand IT Confluent
Big Data CloudOps Engineer Xpand IT Mongo DB
Big Data CloudOps Engineer Xpand IT Spark
Big Data CloudOps Engineer Xpand IT Azure
Big Data CloudOps Engineer Xpand IT Cloudera
Big Data CloudOps Engineer Xpand IT Databricks

SKILLS YOU NEED TO HAVE

  • MSc / BSc in Informatics and Computers, Information Systems or Computer Science
  • Good knowledge of Linux operating systems are valued
  • Good shell scripting knowledge is valued
  • Knowledge of the objectives and terminology of distributed high availability systems is valued
  • Team player and problem solving skills
  • Good communication skills (written and spoken)
  • Fluent English (written and spoken)

// Will be a nice plus if you have:

  • Hands on experience in setting up Spark, Hive or Apache Hadoop
  • Hands on experience about automation tools like Ansible, Terraform or CloudFormation
  • Curiosity about Big Data technologies such as Hadoop, Kafka, MongoDB
  • Curiosity about Kubernetes and the various existing flavors Openshift, Rancher, AKS or EKS
  • Curiosity about the Cloud services that make up Azure Big Data Stack or AWS Big Data Stack, such as Databricks, Azure Synapse or Amazon S3

// Learn more about Big Data area:

Apply here

As a Big Data System Engineer, every day is challenging: between the clusters deployments from scratch and the optimization of distributed systems, it is absolutely crucial to have a deep understanding of the ecosystem’s multiple services, dealing with many different contexts.

Pedro Martins, Big Data System Engineer @Xpand IT
Big Data ClouOps Engineer Xpand IT

Videos that tell you the whole story

Xpand IT: You Have to Live it!

Summer Trip

Be an Xpander

Life at Xpand IT

XTech Community

Meetup

Sara GodinhoBig Data CloudOps Engineer
read more

Big Data Project Manager

Job Opportunity Big Data Project Manager Xpand IT

Big Data Project Manager

Complex problems require the right expertise! Today one of the biggest challenges is data storage and processing, across these three main domains (3Vs): Volume, Velocity and Variety.

At Xpand IT, the Big Data technological area develops and implements architectures and software solutions that represent the state of the art on the capture, ingestions, process, enrich, storage and management of critical data from huge clusters where the 3Vs are always present. In what concerns to technology stack, we take advantage of almost all state-of-the-art frameworks in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services, MongoDB using Java and Scala as programming language to interact with them.

YOUR ROLE

As a Big Data Project Manager you’ll assume a set of responsibilities that range from team coordination, to project scope and duration control. You should think and act out of the box acting as a central point of communication between the entire team and the other teams external to the projects. In particular, in the Big Data area, you will have the opportunity to be in contact with large-scale and highly complex solutions.

Your daily activities will include:

  • Coordinate the various project teams
  • Define scope of project releases and sprints, ensuring the involvement of all stakeholders
  • Anticipate and manage problems, conflicts and risks that arise during project releases
  • Ensure fluid and timely communication between all teams that have an impact on the projects
  • Develop and implement metrics for monitoring and evaluating project execution
  • Ensuring the quality and excellence of each delivery

SKILLS YOU NEED TO HAVE

  • BSc/MSc in Computer Engineering or equivalent
  • At least 2 years of experience as a Tech Lead or Project Manager in the IT area
  • Background or knowledge of Java and/or SQL development good practices
  • Interest in Big Data ecosystems and their architecture
  • Experience with development methodologies (Scrum) and tools to support development (Confluence, JIRA, Git, Jenkins, Bamboo)
  • Motivation, willingness to innovate, good communication skills and teamwork. motivation
  • Good communication skills (written and spoken)
  • Fluent English (written and spoken)

// Will be a nice plus if you have:

  • PMP and SCRUM certification

// Learn more about Big Data area:

Apply here

At Xpand IT you’ll discover that working in Big Data means working with a great and knowledgeable team that will help you leverage a vast set of technologies for creating large scale distributed systems. We really believe this is a collaborative journey to excellence, where each and every one of us makes a difference. Here, we are truly bigger than the sum of all individuals!

Luís Vicente, Big Data and Data Science Manager @Xpand IT
Big Data Project Manager Xpand IT

Videos that tell you the whole story

Xpand IT: You Have to Live it!

Summer Trip

Be an Xpander

Life at Xpand IT

XTech Community

Meetup

Sara GodinhoBig Data Project Manager
read more

Big Data System Engineer

Job Opportunity Big Data System Engineer Xpand IT

Big Data System Engineer

Complex problems require the right expertise! Today one of the biggest challenges is data storage and processing, across these three main domains (3Vs): Volume, Velocity and Variety.

At Xpand IT, the Big Data technological area develops and implements architectures and software solutions that represent the state of the art on the capture, ingestions, process, enrich, storage and management of critical data from huge clusters where the 3Vs are always present. In what concerns to technology stack, we take advantage of almost all state-of-the-art frameworks in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services, MongoDB using Java and Scala as programming language to interact with them.

YOUR ROLE

As a Big Data System Engineer you’ll have a fundamental role in several phases of the adoption of the Big Data platform, participating in the analysis, definition and sizing of distributed storage and / or computing systems, setup, upgrade, securization and tuning. For these critical systems, a special focus on performance and security is crucial, as well as the implementation of the best service development practices to serve as the basis for monitoring tools. Usually this role also works closely with the development teams in the design, development and installation of application solutions, large-scale data processing and storage.

Your daily activities will include:

  • Setup / upgrade / securitization / tuning of big data platforms on a large scale in critical environments
  • Implement security rules and policies on Big Data platforms
  • Recommend and periodically update Big Data platforms (hot fixes, patches, etc.)
  • Configure good practices for monitoring the infrastructure of Big Data clusters
  • Analyze hardware and software requirements for each project to be implemented
  • Design and develop new processes for better stability and performance maintenance of environments
  • Participate and help solve performance, scalability and security issues

// Stacks: Shell Linux (e.g., bash), Cloudera, Confluent, Azure Data Services, MongoDB; MIT Kerberos ou Windows Active Directory

Big Data System Engineer Confluent
Big Data System Engineer MongoDB
Big Data System Engineer Xpand IT
Big Data System Engineer Xpand IT
Big Data System Engineer Xpand IT
Big Data System Engineer Xpand IT

SKILLS YOU NEED TO HAVE

  • MSc / BSc in Information Systems and Computer Engineering and/or Computer Science
  • Good knowledge on Linux operating systems is valued
  • Good knowledge of Shell Scripting is valued
  • Knowledge of High Availability/Distributed systems and its goals and terminology
  • Strong communication skills (written and spoken)
  • Team playerand problem solving skills
  • Fluent English (written and spoken)

// Will be a nice plus if you have:

  • Hands on experience in setting up Spark, Hive, or other Apache Hadoop
  • Curiosity about Big Data technologies such as Hadoop, Kafka and MongoDB

// Learn more about Big Data area:

Apply here

As a Big Data System Engineer, every day is challenging: between the clusters deployments from scratch and the optimization of distributed systems, it is absolutely crucial to have a deep understanding of the ecosystem’s multiple services, dealing with many different contexts.

Pedro Martins, Big Data System Engineer @Xpand IT
Big Data System Engineer Xpand IT

Videos that tell you the whole story

Xpand IT: You Have to Live it!

Summer Trip

Be an Xpander

Life at Xpand IT

XTech Community

Meetup

Sara GodinhoBig Data System Engineer
read more

Big Data Software Engineer

Job opportunity Big Data Software Engineer Xpand IT

Big Data Software Engineer

Complex problems require the right expertise! Today one of the biggest challenges is data storage and processing, cross these three main domains (3Vs): Volume, Velocity and Variety.

At Xpand IT, the Big Data technological area develops and implements architectures and software solutions that represent the state of the art on the capture, ingestions, storage and management of critical data from huge clusters where the 3Vs are always present. In what concerns to technology stack, we take advantage of almost all state-of-the-art frameworks in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services or MongoDB using Java and Scala as programming language to interact with them.

YOUR ROLE

As a Big Data Software Engineer you’ll play a key role in the team along with Big Data System Engineers to create the best software solutions applying big data best practices in terms of architecture and systems design. You’ll guarantee backend software performance, reliability and scalability is achieved independently of how fast data clusters grow or the throughput of information increases.

Your daily activities will include:

  • Implement software solutions that include loading, preprocessing and ingestion from disparate data sets into big data clusters.
  • Design robust and reliable software solutions independently of amount of input data.
  • Implement big data industry standards into the final software solution
  • Analyse complex problems that need solutions for efficiently manipulate huge amounts of information
  • Develop data models and data organizations that optimize “search” and “store” operations in large sale distributed systems
  • Design APIs for swift data tracking and query data at high speeds

// Stacks: Java; Scala; HDFS, Hive, Impala, Spark, Kafka/Confluent; MongoDB, HBase

Big Data Software Engineer Apache Spark
Big Data Software Engineer Confluent
Big Data Software Engineer Kafka
Big Data Software Engineer MongoDB
Big Data Software Engineer HBase
Big Data Software Engineer MongoDB
Big Data Software Engineer Hive
Big Data Software Engineer Scala

SKILLS YOU NEED TO HAVE

  • MSc / BSc in Information Systems and Computer Engineering and/or Computer Science
  • Strong knowledge on Linux operating systems
  • Experience with Java oriented technologies (JBoss, Spring, Spring MVC, Hibernate, REST/SOAP)
  • Experience of design patterns to implement advanced software solutions.
  • Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.)
  • Strong experience in using Eclipse, Maven, Jenkins, GIT, JIRA or equivalent tools
  • Strong communication skills (written and spoken).

// Will be a nice plus if you have: 

  • Knowledge or experience with Apache Spark, Kafka or the Hadoop ecosystem
  • Team player and problem solving skills

// Learn more about Big Data area:

Apply here

A Big Data Software Engineer is challenged every day to build scalable and resilient data processing systems that are the groundwork for data-driven decisions.

André Pires, Big Data Software Engineer @Xpand IT
Big Data Software Engineer Xpand IT

Videos that tell you the whole story

Xpand IT: You Have to Live it!

Summer Trip

Be an Xpander

Life at Xpand IT

XTech Community

Meetup

Catarina RochinhaBig Data Software Engineer
read more