Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

sync-ggml-26-07-30

talk.llama-coreml

threads

timing

try-fix-abort

whisper-rc-v1.9.4

whisper-rc-v1.9.5

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3422

#3422

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3934

#3934

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3947

#3948

#3948

#3950

#3956

#3957

#3959

#3962

#3963

#3964

#3964

#3966

#3969

#3970

#3972

#3975

#3976

#3976

#3977

#3979

#398

#3980

#3980

#3981

#3982

#3985

#3987

#3987

#3989

#3990

#3991

#3994

#3996

#3997

#3998

#3999

#4000

#4001

#4002

#4003

#4004

#4005

#4006

#4007

#4008

#4009

#4010

#4012

#4013

#4015

#4016

#4017

#4019

#4020

#4020

#4021

#4021

#4022

#4023

#4023

#4025

#4028

#4028

#4029

#4031

#4032

#4033

#4033

#4034

#4035

#4038

#404

#4040

#4044

#4045

#4047

#4048

#4049

#4049

#4050

#4051

#4052

#4053

#4054

#4054

#4055

#4055

#4056

#4057

#4058

#4060

#4061

#4064

#4065

#4066

#4066

#4068

#4068

#4069

#4070

#4072

#4073

#4074

#4077

#4079

#4080

#4082

#4083

#4086

#4086

#4087

#4087

#4089

#4089

#409

#4091

#4095

#4095

#4096

#4096

#4097

#4097

#4099

#4099

#41

#4100

#4100

#4101

#4102

#4105

#4107

#4108

#4108

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

b4938

b5127

b5130

b5454

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

v1.9.2

v1.9.3

v1.9.4

v1.9.5

Mono Color

• 33cadde176 ggml : update ggml_prec specification (llama/26675) Georgi Gerganov 2026-09-08 09:06:24 +03:00
• 707c3ee1a6 hexagon: add RELU and LEAKY_RELU ops (llama/28585) Todor Boinovski 2026-09-07 17:04:25 -07:00
• 34f5336356 Revert "CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (#24546)" (llama/28551) Piotr Wilkin (ilintar) 2026-09-07 16:28:19 +02:00
• 0f9591a165 webgpu: format the GET_ROWS case block (llama/28542) Pascal 2026-09-07 15:55:14 +02:00
• b61186de01 sycl: add a batched L2_NORM kernel (llama/28222) Titaniumtown 2026-09-07 06:24:14 -07:00
• 8ce432f16d vulkan: add DeepSeek-V4 hyper-connection fused ops (DSV4_HC_COMB/PRE/POST) (llama/26578) Kevin HopperandKevin Hopper 2026-09-07 08:24:03 -05:00
• 4c5a9a02a1 CUDA: size routed MoE MMQ N-tiles from typical expert width on RDNA3 (llama/24546) ravel7524andCarl Philipp Klemm 2026-09-07 09:22:42 -04:00
• f15e1a67ab ggml: add gfx90c HIP support (llama/26454) AuroraRAS 2026-09-07 22:21:42 +09:00
• a11d16a8d5 CUDA: branchless Q4_K/Q5_K unpack to speed up mmvq, L2 prefetch on DGX Spark (llama/26705) Pranesh Gonegandlaandpraneshgo 2026-09-07 11:36:58 +00:00
• 60e475f215 vulkan: support type-aligned GET_ROWS (llama/28253) Jeff BolzandAiChiTuDouPian 2026-09-07 05:22:10 -05:00
• c6135ac226 ggml-cuda: fix divergent barrier in f16 flash attention (llama/27870) Siavash Norouzi 2026-09-06 23:23:21 -07:00
• 1da558c5cd ggml: allow backend inputs to not create another split (llama/28387) Aman Gupta 2026-09-07 14:10:40 +08:00
• 8d3ed20053 vulkan: rms_norm fusion opportunities (llama/28024) Jeff Bolz 2026-09-07 01:08:28 -05:00
• 088b3b4ad0 vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) (llama/27765) Anjielon 2026-09-07 06:35:30 +02:00
• ad344d1668 opencl: properly choose weights pack for q4_K, q5_K mul_mat (llama/28402) lhez 2026-09-06 08:33:08 -07:00
• a0e75c849a cuda: fixes races in mmid and mmf (llama/28475) Aman Gupta 2026-09-06 19:45:01 +08:00
• 1299eb6c15 metal : add remaining fa-vec tunings for M2 Max (llama/28458) Niklas Wenzel 2026-09-06 07:37:01 +02:00
• 614c74ab60 metal : fix memory leak in early return (llama/28399) Niklas Wenzel 2026-09-05 12:19:47 +02:00
• 0006e3e2e2 sycl : fix test-backend-ops CI break && restore Kronecker product FWHT support (#28016) (llama/28254) Jingxin (Philip) Li 2026-09-05 10:37:12 +08:00
• 07796107ef sycl: attribute device allocations by site (GGML_SYCL_MEMTRACE) (llama/27631) Nick Farrell 2026-09-05 12:36:02 +10:00
• ad218df420 metal : add remaining fa-vec tunings for M3 (llama/28396) Isaac 2026-09-05 00:08:34 +05:30
• 25c6ab5d99 opencl: extend the elementwise and data‐movement op coverage (#27633) Hongqiang Wang 2026-09-04 10:12:26 -07:00
• 7fb2dafcb8 opencl: add Adreno xmem SDPA path (llama/26331) yzyyzyhhhandhappyyzy 2026-09-05 01:12:05 +08:00
• 70598eee9c scripts : fix sync (#0) Georgi Gerganov 2026-09-14 16:59:16 +03:00
• f133970bbb ci : use devlab-dispatch for npu-amd-windows (#4060) Adrien Gallouët 2026-09-14 06:35:58 +02:00
• 1da4dc82fa ci : rename cublas to cuda in release.yml (#4057) Daniel Bevenius 2026-09-11 16:13:24 +02:00
• 0261298154 ci : use devlab-dispatch for npu-amd-linux (#4056) Adrien Gallouët 2026-09-11 09:35:25 +02:00
• 927cfce34f metal : remove leftover ggml-metal.metal kernels file (#4051) v1.9.4 b5130 Daniel Bevenius 2026-09-10 20:00:34 +02:00
• dd80eb2afd scripts : use sed instead of grep for version parsing [no ci] (#4052) Daniel Bevenius 2026-09-10 19:49:10 +02:00
• 1fa6dfa05f ci : update WoA CUDA 13.4 to use 13.4.1 GA (#4053) Daniel Bevenius 2026-09-10 19:22:25 +02:00
• a2b36eb677 whisper : bump version to 1.9.4 (#4050) b5127 Daniel Bevenius 2026-09-10 12:17:05 +02:00
• 7eefef896e whisper : bump version to 1.9.4 whisper-rc-v1.9.4 Daniel Bevenius 2026-09-10 10:03:22 +02:00
• 6fb4cd675c ci : add Windows On ARM support to release job (#4048) Daniel Bevenius 2026-09-10 09:51:35 +02:00
• c44b60b805 whisper : call encoder_begin_callback before language auto-detect (#3936) Javier De Jesus 2026-09-08 13:35:34 +02:00
• 6d0ed91499 whisper : re-seed decoder 0 between calls (#4025) davidcabcabanddavid 2026-09-08 10:58:05 +01:00
• cec4dbe5d5 ci : update close-issue job to not close issues (#4045) Daniel Bevenius 2026-09-08 11:57:20 +02:00
• 79f2d92112 tests : load backends before init when built with GGML_BACKEND_DL (#4031) Abir Deol 2026-09-07 22:14:42 -07:00
• 61e6ccade0 server : return language in detect response (#4035) Álvaro Justen 2026-09-08 02:12:52 -03:00
• 52a939a2a7 sync : ggml Georgi Gerganov 2026-09-04 13:40:00 +03:00
• a937f4e8ef ggml : bump version to 0.23.0 (ggml/1618) Georgi Gerganov 2026-09-04 13:24:44 +03:00
• 11d4eec830 metal : add remaining fa-vec tunings for M3 Max (llama/28373) Niklas Wenzel 2026-09-04 11:46:31 +02:00
• 140e57a4e2 ggml : replace compile definitions with version.h.in (llama/28364) Daniel Bevenius 2026-09-04 10:28:23 +02:00
• e2389eb99c ggml : rename and make private ggml_op_alloc_size_may_expand() (ggml/0) Georgi Gerganov 2026-09-04 13:08:43 +03:00
• 1b37beadd7 ggml : don't crash when backend search path can't be read (llama/28271) Adrien Gallouët 2026-09-04 09:24:06 +02:00
• f32e6fa0c8 ggml : remove GGML_CUDA_PEER_MAX_BATCH_SIZE (llama/28177) Adrien Gallouët 2026-09-04 09:22:01 +02:00
• e1bbe40520 ggml-cpu(s390x) : fix q5_1 uninitialized v_acc (llama/28332) Aaron Teo 2026-09-04 13:55:50 +08:00
• d1e0e6491f sycl: fuse rms_norm+mul+add and add+add residual chains (llama/27610) Frosty40 2026-09-03 23:05:40 -05:00
• 36f170e5fe SYCL: Refactor GGML_SYCL_ENABLE_MKL_FA to global var (llama/26863) Ozymandias_EBON 2026-09-03 21:45:53 -05:00
• d784add75f opencl: quant lm_head / decode GEMV and medium-batch GEMM optimizations (speculative decoding/MTP) (llama/26477) Hongqiang Wang 2026-09-03 09:46:19 -07:00
• 0a4a95c86e tune MMVQ to MMQ crossover for SM87 (llama/28285) kbenkhaled 2026-09-03 12:40:42 -04:00
• 4dd48dde35 metal : add sparse FA (llama/28098) Georgi Gerganov 2026-09-03 13:51:13 +03:00
• d55d345e69 metal : fix glu dispatch with ne00 = 1 (llama/28306) Georgi Gerganov 2026-09-03 13:25:41 +03:00
• 25350b579e CUDA: Allow concurrent streams per split for multi-GPU (llama/28198) 3 people 2026-09-03 12:03:03 +02:00
• 47d348a278 vulkan: fix FA dequant path engagement (llama/28190) Nathan Wilson 2026-09-03 15:40:34 +07:00
• f24a38605b sycl : enhance the api to support peer-to-peer copy (llama/27550) Neo Zhang 2026-09-03 15:41:07 +08:00
• a704770e3b sycl: reduce redundant work in Q4_K multi-column MMVQ (llama/27062) EurekaticandRaulAbejonDelgado 2026-09-03 08:59:06 +02:00
• e5605697ce finetune: fix no KV cache (llama/27199) Xuan-Son Nguyen 2026-09-02 23:53:32 +02:00
• 37f0f443d7 ggml-hexagon: add F16 support for unary ops (llama/28228) cqderek 2026-09-03 03:59:36 +08:00
• 1bdda1e366 metal : add fa-vec tunings for M3 (llama/28236) Isaac 2026-09-02 23:43:12 +05:30
• 3a1c7d6b6f metal : fix memory query under low-memory conditions (llama/27701) 3 people 2026-09-02 20:09:46 +02:00
• 4d343d7c05 ggml-cuda : remove unused vars (llama/28235) Adrien Gallouët 2026-09-02 18:54:11 +02:00
• 519df618df CUDA + ggml: add sparse-fa for DSV4/GLM (llama/27970) Aman Gupta 2026-09-02 19:57:37 +05:30
• c2b400754b ggml: avoid KleidiAI buffer type init on dispatch (llama/27891) Aman Chadha(IVIXMMI)andAcmmi 2026-09-02 11:46:15 +05:30
• dc70853ec2 hexagon: MUL_MAT and MUL_MAT_ID fusion and fixes (llama/28202) Max Krasnyansky 2026-09-01 23:15:21 -07:00
• 1c7d35e14a vulkan: handle larger batch sizes (>4) efficiently for IQ3_S mat-vec (llama/27449) Laurent ZuijdwijkandMarshall 2026-09-02 07:14:52 +01:00
• a9e58612c5 vulkan : only request VK_KHR_shader_bfloat16 extension if supported (llama/28155) Mads Marquart 2026-09-02 08:13:25 +02:00
• d57ae98246 ggml-cpu : conditionally add SpacemiT IME kernel sources (llama/27961) Alan Tseng 2026-09-02 14:12:28 +08:00
• 35133c94c5 opencl: fix out‐of‐bound reads in the Adreno image kernels (#27632) Hongqiang Wang 2026-09-01 22:28:45 -07:00
• c94921f8c6 hexagon: add missing FARF logs for cpy/get_rows/set_rows/gdn ops (llama/28217) Trivikram Reddy 2026-09-02 00:20:29 -05:00
• fcc2feee2f metal : add metallib build support for xcframework (llama/28163) Jhen-Jie Hong 2026-09-02 07:45:56 +08:00
• 2c486783ab cuda: fuse MoE weighted expert reduction (llama/25952) anujj 2026-09-02 01:18:47 +05:30
• f162a19475 Revert "sycl : add Kronecker product FWHT support for sizes 384, 640, 768, 12…" (#28184) Titaniumtown 2026-09-01 09:04:31 -07:00
• 408faaafce sycl : add Kronecker product FWHT support for sizes 384, 640, 768, 1280 (llama/28016) Jingxin (Philip) Li 2026-09-01 23:47:08 +08:00
• 5f07f856c5 metal : add fa-vec tuning for M2 Pro (llama/28122) Lukasz Stolcman 2026-09-01 15:24:44 +02:00
• 8cca1a3616 metal : add fa-vec tunings for A18 Pro (MacBook Neo) (llama/28152) Jhen-Jie Hong 2026-09-01 21:15:59 +08:00
• a245a8f48f metal : fix more leaks due to missing autoreleasepools (llama/27883) Niklas WenzelandYiChen Lv 2026-09-01 13:50:47 +02:00
• 870db2afa1 metal : add fa-vec tuning for M2 Max (llama/28015) Georgi Gerganov 2026-09-01 13:37:40 +03:00
• 4f3a2a4b79 sycl : support limit max alloc memory within 2GB for host-pinned memory (llama/27559) Neo Zhang 2026-09-01 18:35:47 +08:00
• 5032008bc8 metal: enable Metal 4.0 tensor API on M5+/A19+ (llama/27461) James Francis 2026-09-01 03:02:42 -06:00
• 8e54c659b5 metal : add fa-vec tunings for M1 Ultra (llama/28088) Buğra Özgürsoy 2026-09-01 00:47:27 +03:00
• f22bb2ea4d CUDA: XOR swizzle flash attn K,V smem fp16 tiles (llama/25635) ynankani 2026-08-31 20:18:01 +00:00
• dbc40efce8 metal : add concat support for quantized types (llama/28116) Georgi Gerganov 2026-08-31 23:16:04 +03:00
• 2f608ab4f8 AVX2: Speed up large batch size prompt processing of IQ models (llama/27402) BartowskiandGeorgi Gerganov 2026-08-31 14:33:50 -04:00
• c6934d0fcf metal : add top-k radix implementation (llama/28073) Georgi Gerganov 2026-08-31 21:31:53 +03:00
• 088c603e29 opencl: tune the quant paths for Intel Xe-LP GPUs to improve its TG and PP performance (llama/26438) Hongqiang Wang 2026-08-31 08:56:22 -07:00
• c648b9a4d0 webgpu : avoid crash when offset is not multiple of 4 in WebGPU ggml_backend_tensor_get() implementation (llama/28045) 3 people 2026-08-31 16:04:38 +02:00
• c1be45b890 ROCm: add radix TOP_K for long rows (llama/27466) Jaden_Mach 2026-08-31 09:00:04 -04:00
• 7614a4c139 metal : add fa-vec tunings for M1 (llama/28078) Niklas Wenzel 2026-08-31 13:58:55 +02:00
• b0f4bc02ed CUDA: extend MOE fusion to specdec, earlier MOE glu fusion and topk-router fusion were restricted to 1 token (llama/27621) ynankani 2026-08-31 11:22:28 +00:00
• 76a51e82d7 sycl : Enhance to get the free memory of Intel GPU (llama/27968) Neo Zhang 2026-08-31 18:33:02 +08:00
• 6ce7b89952 vulkan: tune mat-vec rows for batched inference on Strix Halo (llama/27909) Simon Teixidor 2026-08-31 11:07:53 +02:00
• 96dddd87f2 ggml : add MUL_MAT to the list of ops that may need additional memory (for WebGPU) (llama/28071) fairydreamingandStanisław Szymczyk 2026-08-31 10:17:23 +02:00
• db00b0196b vulkan: top_k radix select for k >= 1024 for Qwen 3.8 Flash Next (llama/28032) Ruben Ortlam 2026-08-31 07:04:34 +02:00
• 01ebd225a7 hexagon: fix CPY fence bug (llama/28033) Shenghan Yang 2026-08-31 02:18:24 +08:00
• e5c96ca45d metal : add remaining Q4_1/Q5_0/Q5_1 fa-vec tunings for M2 (llama/28017) codemonkey 2026-08-31 02:00:10 +08:00
• 4089fa628a rpc: avoid serializing buffers from other servers (llama/26500) hmirinandGeorgi Gerganov 2026-08-31 02:26:16 +09:00
• 749683d30f ggml : fix ggml_backend_buft_get_alloc_size() guard (llama/28038) Georgi Gerganov 2026-08-30 20:25:15 +03:00
• e9583f075a ggml: add SWIGLU_CLAMP (llama/27930) Aman Gupta 2026-08-30 20:30:02 +05:30
• e900a732c8 CUDA: use the fast mm_ids_helper path for any n_expert_used (llama/27978) Pascal 2026-08-30 16:06:32 +02:00
• 35d9e2237e hip: tune rdna 3 mmq config (llama/26284) itterative 2026-08-30 13:47:21 +03:00