HPC and AI infrastructure

AI and HPC infrastructure, built for real workloads.

GPU and CPU compute, Linux and scientific software, data pipelines, parallel storage and low-latency networking, engineered as one system. Two decades designing, building and operating on-premises and cloud infrastructure for AI training, big-data workloads and scientific computing. We build and lead engineering teams, and help grow the communities around AI and HPC centers: researchers, platform engineers and operators working together. From a single GPU server to AI factories and research centers, our work spans architecture, deployment, performance tuning and day-to-day operation.

Two decadesEngineering and technical leadership
Thousands of nodesOn-premises and cloud
Hands onArchitecture through administration
Day to day
HPC and AI

The part of the stack most people cannot hire for.

Compute, fabric and storage are one system, and the failures that matter happen between them rather than inside any one of them. We work across all three, from architecture and procurement through build-out, benchmarking and day-to-day operation.

01

Cluster architecture and build-out

Full stack design and delivery: hardware selection, provisioning, operating system and image management, node classes, and the capacity planning behind them. Bright Cluster Manager, OpenHPC, HPCM, xCAT. Multi-site and multi-region estates.

02

InfiniBand and low latency fabric

Fabric design and management from EDR through HDR and NDR, fat tree and dragonfly topologies, OpenSM routing engines, NVIDIA UFM, RoCE and RDMA. Switch and adapter firmware, port configuration, and the diagnostics that separate a fabric problem from an application problem.

03

Parallel and scale-out storage

GPFS and IBM Storage Scale, Lustre, WekaFS, VAST, Pure, Isilon, DDN, BeeGFS and CEPH. Tiering and policy, erasure coding, data movement, and benchmarking that measures the workload rather than the page cache.

04

GPU, CUDA and AI stacks

A100, H100, DGX systems, NVLink, DCGM, Intel Max and AMD Instinct. CUDA and ROCm, NCCL collective tuning, PyTorch and TensorFlow environments, containerized delivery through Apptainer and Kubernetes.

05

Schedulers and workload management

Slurm, PBS Pro, LSF, Grid Engine and Univa. Partition and QoS design, GPU and license-aware scheduling, fair share, accounting, and the migrations between schedulers that organizations put off for years.

06

Cloud and hybrid HPC

AWS ParallelCluster, SOCA and IDEA, FSx for Lustre, EFA and the surrounding services. Azure HPC across regions. Lift and shift from on-premises, and the more common case where the honest answer is that only part of the workload should move.

Other areas

The infrastructure around the cluster.

HPC does not sit on its own. It depends on identity, network, storage, monitoring and compliance that have to work, and on people who can run them. AI is changing how each of these is done, and the shift is mostly practical rather than dramatic.

Enterprise IT and infrastructure

Linux and UNIX estates at scale, identity and directory services, virtualization, configuration management with Ansible and Puppet, monitoring through Prometheus, Grafana, Nagios and Ganglia. Migrations off legacy platforms, including Solaris and HP-UX, where the hard part is the application stack rather than the operating system.

Where AI changes it: telemetry has always been collected faster than anyone could read it. Anomaly detection across metrics and logs turns that backlog into something that surfaces problems before a user reports them, and capacity forecasting stops being a spreadsheet exercise.

Infrastructure

Low latency networking

Spine and leaf design, 10, 25 and 100 gigabit platforms, Juniper, Arista, Cisco and Brocade, OSPF and BGP, VXLAN and MLAG. Campus and transcontinental network optimization for research and engineering traffic that behaves nothing like office traffic.

Where AI changes it: traffic classification and fault correlation across a fabric this size is pattern work, and pattern work is where machine learning earns its place. It shortens the gap between a link degrading and someone knowing which link.

Network

Security, compliance and audit

Building and running research and clinical computing under the regimes that govern it: CUI handling to NIST SP 800-171, NIH controlled-access genomic data, HIPAA, GxP and PCI. SELinux and RBAC, vulnerability management, access and filesystem auditing, threat management across cloud and on-premises. NACI Public Trust clearance. Security officer responsibility on a federal modeling platform.

Where AI changes it: evidence gathering. Most audit effort goes into collecting and correlating what a control actually did, not into judgment. Automating that collection leaves more room for the part that needs a person.

Compliance

Data management and movement

Petascale storage planning, purchase and migration. Backup and archive across enterprise and cluster filesystems, tape libraries, snapshot and replication frameworks. Transfer at distance with Aspera and GridFTP. Retention and access control in environments where the data has legal weight.

Where AI changes it: placement. Deciding what belongs on flash, what belongs on capacity tiers and what should have been deleted is a prediction problem, and policy engines have historically guessed with very blunt rules.

Storage

Teams, vendors and budgets

Group lead and IT director roles: hiring and technical screening, mentorship, team structure, vendor and contract management, budgeting and expansion planning. Running engineering, development and support functions together rather than as separate silos.

Where AI changes it: mostly in what a small team can now cover. The practical question is which work it removes and which work it quietly creates, and that is worth answering before rather than after a reorganization.

Leadership
Regulated environments

The rules the cluster has to live inside.

Research computing is rarely unregulated. Genomic data arrives with a data use agreement attached, a DoD subcontract brings CUI obligations onto your storage, and the moment a foreign national gets a login on a machine holding controlled technology you are in export control whether anyone planned for it or not. These are the frameworks the work has been delivered under — described as engagements, not as badges.

CUI

Federal and controlled unclassified information

NIST SP 800-171 across storage, scheduler and identity, with the system security plan and POA&M that go with it. NIST SP 800-53 on federal systems, FISMA responsibility as a named security officer, and CMMC readiness for defense subcontracts. DISA STIG and CIS Benchmark hardening on compute at scale. NIST SP 800-88 media sanitization on decommission. FIPS 140 validated cryptography where it is required, and the exemption argument where a validated module does not exist for the hardware.

NIH

Controlled-access research data

The NIH Genomic Data Sharing Policy and the dbGaP security best practices as they actually apply to a shared cluster: where controlled-access data may live, who may reach it, how access is logged, and how it is destroyed at the end of the approved period. NIH Data Management and Sharing plans, data use agreements and honest broker arrangements, IRB-driven access boundaries, and the awkward part — enforcing per-study separation on a filesystem several hundred other users also mount.

Export

Import, export and sanctions

EAR and ECCN classification of HPC hardware, GPUs and the software stack, and ITAR where it applies. Deemed export is the one that catches universities: giving a foreign national an account on a machine holding controlled technology is an export, and shared clusters are built to do exactly that. Technology control plans, restricted party and OFAC screening, Entity List constraints on accelerator procurement, and where the fundamental research exclusion genuinely applies rather than where people wish it did.

Health

Clinical and pharmaceutical

HIPAA Security Rule on estates that are simultaneously research and clinical, GxP and 21 CFR Part 11 for electronic records and signatures, PCI DSS, and GDPR where a collaboration crosses into the EU. Audit evidence that can be produced on demand rather than reconstructed the week before an assessment.

ISO

Standards and control frameworks

Systems designed and operated to ISO/IEC 27001 information security controls, ISO/IEC 27017 and 27018 for cloud and personal data in cloud, ISO/IEC 20000 service management practice, and SOC 2 control objectives. Where an organization is pursuing certification, the work is the control implementation and the evidence that survives the audit.

In practice

What this looks like on a cluster

Compliance fails on shared HPC in predictable places: a scratch filesystem nobody scoped, an epilog that never deletes, a scheduler prolog that leaks a path, home directories mounted everywhere by default, node images drifting apart, and audit logging that stops at the login node. The useful work is closing those, then proving they are closed — not producing a policy document that describes a system nobody has actually configured.

Track record

Where the work has been done.

Roles as HPC architect, engineer, group lead and IT director, in environments where the machines are expensive and the deadlines are external.

8

NVIDIA AI factory environments, GPU fabric, scheduler and parallel storage integration

HPC and AI infrastructure architect
5,000

Node liquid-cooled Cray and HPE clusters, federal weather modeling

Senior HPC architect and security officer
1,680

Nodes across three sites in two continents, semiconductor manufacturing

Group lead, EDR to HDR fabric upgrade
520

Nodes migrated from on-premises Linux and HP-UX to cloud, automotive

HPC architect, scheduler and MPI migration
12,000

Users on a mixed research and clinical estate, academic medicine

UNIX, network and SAN systems manager
4+

High-throughput HPC estates in academic medicine, clinical research and defense postgraduate education

Cluster architecture, GPFS and scheduler design
Right-sizing

Most of this work starts a lot smaller than that.

Those numbers are where the work has led. They are not the price of admission, and they are not the minimum engagement. A single GPU server that is not delivering the throughput it should, a storage mount that keeps dropping under load, a scheduler nobody has retuned since the day it was installed, a benchmark that disagrees with the vendor's datasheet — these are the same problems as the large ones with fewer zeros on the end, and most of them are an afternoon or a week rather than a project. If that is all you need, that is what we will quote, and if you do not need outside help at all we will tell you that instead.

Worked with

Organizations and environments.

Work delivered in these environments, as an employee, contractor or through partners and vendors. Listed as engagements worked on, not as clients of this practice.

AI factories

GPU cloud and AI infrastructure

Alembic, IREN, Deutsche Telekom, Microsoft, Anthropic, NScale, CoreWeave, BoostRun and Novartis.

Academic medicine

Research and clinical HPC

Atrium Health Wake Forest Baptist, Albert Einstein College of Medicine, Weill Cornell Medicine, Memorial Sloan Kettering and Mayo Clinic.

Federal

Agencies and national laboratory

NOAA, NASA, Brookhaven National Laboratory and the Naval Postgraduate School.

Sectors

Regulated and demanding

AI factory and GPU cloud build-outs, semiconductor equipment, aerospace and aviation, automotive engineering, federal weather modeling, pharmaceutical research, academic medicine, clinical research computing, clinical pathology, defense postgraduate education, and a national laboratory.

Certifications

Held and current

Red Hat Certified Engineer across RHEL 3, 5 and 7. Sun Certified Systems Administrator. FreeBSD Certified Associate. Juniper JNCIS-SEC and JNCIS-ENT. Cisco CCNA. Microsoft MCSE and MCSA. NACI Public Trust clearance.

Education

Computer science

Master's degree in computer science. Two decades of practice since, most of it hands on, across every layer from the cabling to the application stack.

Audits

Independent review, when you need an outside read.

Separate from build and operate work: a scoped, evidence-backed assessment of what is actually exposed or underperforming, delivered as a findings register rather than a conversation.

01

Infrastructure and fabric review

Cluster, fabric and storage assessed against what the hardware should deliver. Benchmarked rather than asserted, with the configuration causes named and a remediation order.

02

Security and compliance review

Identity and access, data protection, logging and incident readiness, mapped to whichever framework applies to you. Every finding carries reproduction steps, an owner and a date.

03

Operating review

A wider look at where money leaks, where work takes longer than it should, and where risk has never been priced. Run as a separate practice at Wirewalk AI.

The same engineers, under two names. The business-facing half of this practice — operating reviews, AI policy and governance, and AI infrastructure sold to people who do not use the word HPC — is at ai.wirewalk.com. One engineering practice; the two sites exist because the buyers read different words, not because there are two companies.

Writing

AI and HPC infrastructure engineering guides.

Practical guides to GPU and CPU performance, Linux and scientific software, AI training pipelines, parallel storage, InfiniBand and low-latency networking. Reproducible checks for AI factories and research centers, with security and recovery covered alongside the infrastructure.

AI pipelines · GPU and CPU benchmarks · Parallel storage · Low-latency networking · Linux software

All articles

Engagements

Defined pieces of work, with a price on them.

Most of this does not need a discovery call first. If you already know what is wrong, or what you want checked, the engagement is listed with a fee and can be ordered directly — on a purchase order if that is what your finance team needs.

From $2,200

Focused engagements

One problem, a day or a week, written up. A benchmark that disagrees with the datasheet, a mount that drops under load, a second opinion before a purchase order goes out.

From $7,000

Infrastructure setup and diagnostics

InfiniBand, RoCE and Ethernet diagnostics with NCCL testing for GPU workloads, parallel filesystem setup and review, scheduler setup and workload review, or independent cluster acceptance testing.

From $2,500

Assessments and programs

Compliance readiness and full assessment against the framework that applies, and the remediation program that follows if you want the controls implemented rather than just listed.

See rates and order Submit a purchase order Purchase orders and invoicing on net 30. Paying in advance takes 5% off.
Get in touch

Tell me what you are building, or what stopped working.

Whether that is a cluster to design, a fabric that is not delivering what it should, a migration nobody wants to own, or a second opinion on someone else's architecture. If the honest answer is that you do not need outside help, we will say so.

Prefer to call? 917-217-7975. Details are used to reply to your enquiry. No mailing list, and nothing shared with vendors or partners.