José Duarte

Project team lead

Team management & organization.

Blockchain development

Working on a blockchain storage solution.

Technologies: Swift (iOS), Python, SQLAlchemy, FastAPI, PostgreSQL, Docker, GitHub Actions

Product research and development

Prototype development for early stage concepts.

Full-stack development

Developed a complete backend with password-based authentication and refresh tokens, a proof of concept iOS app with Apple Maps integration, a data scraping pipeline to feed the backend and app, deployed all infrastructure on a self-hosted Linux machine and performed system administration.

Technologies: Swift (iOS), Python, SQLAlchemy, FastAPI, PostgreSQL, Docker, GitHub Actions

Feature development and maintenance

Maintain the existing codebase well as developing new features for both the core product and the supporting ecosystem.

CI/CD development

Migrated the existing (self-hosted) CI/CD pipeline from Azure Pipelines to GitHub Actions. Maintained the new pipeline, reducing runtime and adding new capabilities.

Technical writing

Wrote tutorials and technical guides for public consumption. Available at Actyx Docs.

Product research

Research potential new products through the exploration of existing tools and development of PoCs.

Technologies: Rust, Typescript, Docker, Electron, Bash, Make, Swift (iOS), GitHub Actions, Azure Blob Storage

In-house data processing system (akin to Prefect, Airflow and Dagster)

Enabling data scientists and researchers to process all the data behind the company's main product. Maintained and developed new features for all the components of the system, from the main server to the worker running each computation.

Library development

Developed libraries for the in-house processing system such as a data access library with several backends (SQLite, PostgreSQL, Azure Blob Storage & File System) and distributed processing library providing Pythonic abstractions to the system.

Data ingestion pipeline

Seamlessly integrating Prefect and dbt beyond the existing official solution and extended dbt with a custom validation framework to suit the business requirements.

Technologies: Python, PostgreSQL, Snowflake, SQLite, Azure Blob Storage, RabbitMQ, Flask, GraphQL, Prefect, dbt

Actively contribute to the open-source community

Contributed with fixes and features to several projects, such as Pandas, SQLAlchemy, Poetry, Python LZ4, Prefect, GitHub Pull Requests for VSCode, Filecoin's Boost, & Firefox.

Published open source projects

#[sealed] - a procedural macro implementing the sealed trait pattern. As of August 2024, it has ~5M downloads and is used in ClickHouse's official Rust client.

#[typestate] - a procedural macro providing an embedded typestate DSL for Rust.

Technologies: Rust, Python, git

Researched the integration of typestates in Rust.

Developed an embedded DSL for Rust, using procedural macros and published articles on the topic.

Technologies: Rust, LaTeX

Developed a CUDA simulation model of the Fire Weather Index.

In partnership with IPMA, my simulation was used to study the prediction of the FWI, using the wildfires of Pedrógão Grande was the analysis period.

Technologies: Python, C, C++, CUDA, QGIS

Managed the team

Overview and organize the team participation in the competitions. Within our first 6 months, we qualified for the CSAW 2020 finals.

Participated in competitions

As a player, I focused on Web, Cryptography and Reverse Engineering. You can find writeups of some of the challenges in my GitHub.

Managed the group

Overview and organized weekly open workshops related to cybersecurity.

Developed an Android SDK for the Portuguese Citizen Card

The developed SDK aimed to provide a simple interface to the Portuguese Citizen Card to Android developers. To showcase the SDK's capabilities, an app was built. One of the key features was the ability to cryptographically sign data.

Technologies: Kotlin, Android, Gradle

Mentored several junior engineers

Helped landing internships and jobs — provided guidance from building a CV, through the interview process and offer negotiation.

Helped leveling up by providing continuous feedback, helping them through new challenges.

Tutored several students on a variety of CS-related topics

Java, C, Haskell and computer networks.