Latest news

Big Data Administrator

Oportunidade de emprego Big Data Administrator Xpand IT

Big Data Administrator

Complex problems require the right expertise! Today one of the biggest challenges is data storage and processing, across these three main domains (3Vs): Volume, Velocity and Variety.

At Xpand IT, the Big Data technological area develops and implements architectures and software solutions that represent the state of the art on the capture, ingestions, process, enrich, storage and management of critical data from huge clusters where the 3Vs are always present. In what concerns to technology stack, we take advantage of almost all state-of-the-art frameworks in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services, MongoDB using Java and Scala as programming language to interact with them.

YOUR ROLE

As a Big Data Administrator you’ll assure the Big Data platform and overall landscape (whatever technology it may be) cluster scalability and performance in the whole Big Data ecosystem.

From the day one, you’ll take part in the analysis and definition of large scale distributed systems but also in its management and integration with external systems. You’ll have a special focus on performance tuning and in application development best practices implementation, both in terms of architecture and security. Usually this role also works closely with application development teams to design, develop and implement the best solutions for data consuming services.

Your daily activities will include:

  • Management of large scale big-data systems in critical environments
  • Install/upgrade and certify big data platforms
  • Implement security rules and policies into big data platforms
  • Periodically recommend and update the big data platforms ( hot fixes, patches, etc
  • Setup best practices for cluster and infrastructure monitoring
  • Analyze hardware, software requirements for each project to be implemented
  • Design and develop new processes for better maintenance of the environments
  • Help the team to troubleshoot the performance issues

// Stacks: Shell Linux (e.g., bash), Cloudera, Confluent, Azure Data Services, MongoDB; MIT Kerberos ou Windows Active Directory

Big Data Administrator Confluent
Big Data Engineer MongoDB
Big Data Administrator Xpand IT
Big Data Administrator Xpand IT
Big Data Administrator Xpand IT
Big Data Administrator Xpand IT

SKILLS YOU NEED TO HAVE

  • MSc / BSc in Information Systems and Computer Engineering and/or Computer Science
  • Strong knowledge on Linux operating systems
  • Good knowledge of Shell Scripting
  • Knowledge about High Availability/Distributed systems and its goals and terminology
  • Strong communication skills (written and spoken)

// Will be a nice plus if you have:

  • Hands on experience in setting up Spark, Kafka, or other Big Data technology
  • Curiosity in Big Data technologies (Hadoop stack, Kafka, MongoDB)
  • Team player and problem solving skills

// Learn more about Big Data area:

Apply here

As a Big Data Administrator, every day is challenging: between the clusters deployments from scratch and the optimization of distributed systems, it is absolutely crucial to have a deep understanding of the ecosystem’s multiple services, dealing with many different contexts.

Pedro Martins, Big Data Administrator @Xpand IT
Big Data Administrator Xpand IT

Videos that tell you the whole story

Xpand IT: You Have to Live it!

Summer Trip

Be an Xpander

Life at Xpand IT

XTech Community

Meetup

Sara GodinhoBig Data Administrator
read more

Data Scientist and Machine Learning Engineer

Oportunidade de emprego Data Scientist Xpand IT

Data Scientist

At  Xpand IT, the Data Science business unit role is to solve new technological challenges, combining software engineering, statistics, and artificial intelligence expertise. This skillset allows to perform extensive data analyses to identify patterns and behaviours in order to try to solve challenging and diverse data driven problems.

YOUR ROLE

As a Data Scientist at Xpand IT you’ll have the opportunity to work on real world problems in some of the top industries: Banking, Telecommunications, Retail, among others. Your mission will always be to retrieve meaningful insights from data, by applying data science techniques such as predictive modelling, pattern recognition and machine learning to specific problems.

Your daily activities will include: 

  • Capture, transform and standardize raw data into intelligible and relevant information;
  • Develop data processing software in programming languages ​​such as Python and R;
  • Research, analyse and implement  state-of-the-art algorithms in order to make the best use of the dataset under analysis;
  • Use predictive and statistical distribution models;
  • Conduct Exploratory Data Analyses and elaborate reports based on it and the logical conclusions.

// Stacks: Python/ R, NumPy, SciPy, scikit-learn, pandas, Keras, TensorFlow, PyTorch, SQL

Data Scientist Phython
Data Scientist R
Data Scientist NumPy
Data Scientist SciPy
Data Scientist Scikit-learn
Data Scientist Pandas
Data Scientist Keras
Data Scientist Tensorflow
Data Scientist PyTorch
Data Scientist SQL

SKILLS YOU NEED TO HAVE

  • MSc/BSc in a revelant area with a strong programming foundation;
  • Knowledge of statistics and mathematical concepts such as probability theory, distributions, hypothesis testing;
  • Knowledge or experience in machine learning: classification, clustering, feature engineering;
  • Programming skills in Python/ R and knowledge of common numerical and machine learning packages (NumPy, SciPy, scikit-learn, pandas, Keras, TensorFlow, PyTorch, PySpark);
  • Knowledge of SQL, data manipulation and visualization techniques;
  • Strong communication skills both in Portuguese and English (written and spoken)

// Will be a nice plus if you have: 

  • Passion for data and its preparation and conversion (raw -> readable -> feature engineering)
  • Experience in text analytics
  • Team player and problem-solving skills 

Apply here

I have exposure to different business domains and to different technologies while working on a fascinating field such as this one. There is a need to elaborate on creative and functional solutions to different problems on a daily basis. Solving each one of these, make us more prepared for tomorrow’s challenges.

Gonçalo Costa, Data Scientist @Xpand IT
André Pires Xpand IT

Videos that tell you the whole story

Xpand IT: You Have to Live it!

Summer Trip anual

Be an Xpander

Life at Xpand IT

XTech Community

Meetup

Sara GodinhoData Scientist and Machine Learning Engineer
read more

Big Data Engineer

Oportunidade de emprego Big Data Engineer Xpand IT

Big Data Engineer

Complex problems require the right expertise! Today one of the biggest challenges is data storage and processing, cross these three main domains (3Vs): Volume, Velocity and Variety.

At Xpand IT, the Big Data technological area develops and implements architectures and software solutions that represent the state of the art on the capture, ingestions, storage and management of critical data from huge clusters where the 3Vs are always present. In what concerns to technology stack, we take advantage of almost all state-of-the-art frameworks in Big Data ecosystem such as Spark, Kafka, Hive/Impala, Azure Data Services or MongoDB using Java and Scala as programming language to interact with them.

YOUR ROLE

As a Big Data Software Engineer you’ll play a key role in the team along with Big Data Administrators to create the best software solutions applying big data best practices in terms of architecture and systems design. You’ll guarantee backend software performance, reliability and scalability is achieved independently of how fast data clusters grow or the throughput of information increases.

Your daily activities will include:

  • Implement software solutions that include loading, preprocessing and ingestion from disparate data sets into big data clusters.
  • Design robust and reliable software solutions independently of amount of input data.
  • Implement big data industry standards into the final software solution
  • Analyse complex problems that need solutions for efficiently manipulate huge amounts of information
  • Develop data models and data organizations that optimize “search” and “store” operations in large sale distributed systems
  • Design APIs for swift data tracking and query data at high speeds

// Stacks: Java; Scala; HDFS, Hive, Impala, Spark, Kafka/Confluent; MongoDB, HBase

Big Data Engineer Apache Spark
Big Data Engineer Confluent
Big Data Engineer Kafka
Big Data Engineer MongoDB
Big Data Engineer HBase
Big Data Engineer MongoDB
Big Data Engineer Hive
Big Data Engineer Scala

SKILLS YOU NEED TO HAVE

  • MSc / BSc in Information Systems and Computer Engineering and/or Computer Science
  • Strong knowledge on Linux operating systems
  • Experience with Java oriented technologies (JBoss, Spring, Spring MVC, Hibernate, REST/SOAP)
  • Experience of design patterns to implement advanced software solutions.
  • Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.)
  • Strong experience in using Eclipse, Maven, Jenkins, GIT, JIRA or equivalent tools
  • Strong communication skills (written and spoken).

// Will be a nice plus if you have: 

  • Knowledge or experience with Apache Spark, Kafka or the Hadoop ecosystem
  • Team player and problem solving skills

// Learn more about Big Data area:

Apply here

A Big Data Software Engineer is challenged every day to build scalable and resilient data processing systems that are the groundwork for data-driven decisions.

André Pires, Big Data Software Engineer @Xpand IT
André Pires Xpand IT

Videos that tell you the whole story

Xpand IT: You Have to Live it!

Summer Trip

Be an Xpander

Life at Xpand IT

XTech Community

Meetup

Catarina RochinhaBig Data Engineer
read more