Data Engineer – (Public Sector)

Data Engineer role at Xtremax involves designing, building, and maintaining data pipelines and systems, with a focus on public sector experience.

Requirements

• Design, develop, and deploy data tables, views, and marts across data warehouses, operational data stores, data lakes, and data virtualization platforms.
• Perform data extraction, cleaning, transformation, and flow, including web scraping when required.
• Build and maintain large-scale batch and real-time data pipelines using data processing frameworks.
• Integrate and collate data silos in a scalable and compliant manner.
• Work closely with Project Managers, Data Architects, Business Analysts, Frontend Developers, Designers, and Data Analysts to deliver data-driven products.
• Develop backend APIs and work on databases to support applications.
• Participate in pair programming and code reviews to ensure code quality and reliability.
• Work in an Agile environment practicing Continuous Integration and Delivery.
• Must have 3 years or more of relevant experience.
• Strong proficiency in data cleaning and transformation (e.g., SQL, pandas, R).
• Hands-on experience with ETL pipeline tools/frameworks (e.g., SSIS, AWS DMS, AWS Lambda, Glue, ECS, EventBridge, Python, Spring).
• Proficient in database design and experience with multiple databases (e.g., SQL, PostgreSQL, MySQL, MongoDB, Cassandra, SQLite, VoltDB, AWS S3, Athena, Postgres/GIS).
• Familiarity with big data frameworks and tools (e.g., Hadoop, Spark, Kafka, RabbitMQ).
• Solid understanding of system design, data structures, and algorithms.
• Comfortable with at least one scripting language (e.g., Python, SQL).
• Experience working in both Windows and Linux environments.
• Nice to Have: Cloud experience with AWS, Azure, or Google Cloud.
• Familiarity with data modeling, data marts, data lakes, virtualization, and warehouses.
• Experience with REST APIs and web protocols.
• Exposure to web scraping frameworks/tools (e.g., BeautifulSoup, Selenium, PhantomJS, Node.js).
• Knowledge of data governance policies, access control, and security best practices.
• Interest in bridging engineering and analytics.
• Experience working on Singapore Government projects will be advantageous

Benefits

• Data Analytics – Specialty certification preferred