Commit Graph

Select branches

Hide Pull Requests

arghh

avx512

batched

bench-memcpy

chess

ci/env

copilot/add-duplicate-text-removal

coreml-with-state

cuda-cublas-opts

diarization

distil-support

experiment/model-compression

fa-decoder

feature/debug-gradle-signing

fix-bench

fix-coreml-ane

fix-vzip

fix_vs_sdl2

gg/alloc-enc-results

gg/bench-fix-print

gg/benches-update

gg/chess

gg/ci-cuda-fix

gg/ci-fix-android

gg/ci-fix-windows

gg/ci-remove-label

gg/cuda-fix-mmvq

gg/cuda-no-async

gg/disable-cuda-graphs

gg/fix-external-encoder

gg/hipblas-fix

gg/make-fix-glob

gg/objc

gg/prompt-tokens

gg/reduce-ctx-use

gg/wchess

gg/whisper-short-audio-check

ggml-backend

ggml-backend-no-sched

ggml-conv

grammar-debug

guided

java-bindings

large-v3

llama-podcast

macros-cvt-fp16

master

metal

metal-and-alloc

nvblas

parallel-states

quantize-encoder

stream

sync-ggml-25-04-02-2

sync-ggml-25-05-07

sync-ggml-25-05-13

sync-ggml-25-09-30-2

sync-ggml-25-12-12

sync-ggml-25-12-17

sync-ggml-26-07-30

talk.llama-coreml

threads

timing

try-fix-abort

whisper-rc-v1.9.4

whisper-rc-v1.9.5

word-ts-2

#1001

#1002

#1003

#1010

#1012

#1015

#102

#1021

#1021

#1024

#1027

#1029

#1031

#1032

#1034

#1037

#1041

#1042

#1045

#1046

#1049

#1054

#1058

#1060

#1062

#1064

#1067

#107

#1074

#1074

#1077

#1081

#1086

#1086

#1092

#1097

#1097

#110

#1101

#111

#1110

#1111

#1112

#1113

#1114

#1115

#1118

#1118

#1120

#1124

#1128

#1129

#1130

#1131

#1134

#1136

#1137

#114

#1142

#1143

#1144

#1147

#1148

#115

#1154

#116

#1160

#1162

#1164

#1164

#1173

#1174

#1196

#1204

#1205

#1209

#121

#1210

#1211

#1212

#1214

#1216

#1217

#1218

#1220

#1224

#1227

#1228

#1229

#123

#1231

#1235

#1238

#124

#1243

#1247

#1250

#1251

#1253

#1254

#1255

#1261

#1261

#1263

#1264

#1265

#1267

#127

#127

#1270

#1275

#128

#1286

#1290

#1293

#1294

#1298

#130

#130

#1303

#1304

#1305

#1306

#131

#1310

#1313

#1317

#1330

#1334

#1335

#1345

#1349

#135

#1350

#1352

#1356

#1358

#136

#1362

#1364

#1368

#1370

#1375

#1375

#1380

#1381

#1381

#1382

#1389

#1400

#1404

#141

#1415

#1417

#1418

#1418

#1420

#1422

#1424

#143

#1432

#1434

#1440

#1441

#1442

#1444

#1445

#1452

#1455

#1455

#1456

#1457

#1458

#1459

#1462

#1466

#1467

#147

#1472

#1473

#1474

#1475

#1478

#1478

#1479

#1484

#1485

#1486

#1487

#1492

#1493

#1499

#1499

#150

#1500

#1500

#1501

#1505

#1519

#1521

#1522

#1523

#1524

#1524

#1529

#1530

#1533

#1534

#1535

#1539

#1541

#1544

#1545

#1546

#1547

#1548

#1549

#1549

#155

#1551

#1554

#1559

#1559

#1560

#1561

#1563

#1563

#1565

#1567

#1568

#1574

#1575

#1576

#1578

#1582

#1583

#1586

#1588

#1589

#1595

#160

#1602

#1604

#1604

#1605

#1606

#1607

#1615

#1617

#1627

#1627

#163

#1633

#1649

#1649

#1650

#1651

#1655

#1658

#1667

#1669

#1672

#1673

#1674

#1675

#1677

#1679

#1679

#1681

#1691

#1692

#1694

#1695

#170

#1701

#1703

#1704

#1713

#1714

#1716

#1717

#1725

#1727

#1728

#1729

#1735

#174

#1740

#1741

#1744

#1747

#1749

#175

#1750

#1753

#1754

#1755

#1758

#1763

#1764

#1765

#1768

#1768

#1772

#1774

#1778

#1781

#1785

#179

#1791

#1791

#1792

#1802

#1806

#1809

#1812

#1813

#1819

#1823

#1823

#183

#1833

#1833

#1838

#1839

#1840

#1841

#1841

#1842

#1850

#1854

#1854

#1857

#1859

#1860

#1861

#1863

#1865

#1871

#1872

#1874

#1878

#1888

#1889

#1890

#1891

#1895

#1897

#19

#1902

#1913

#1913

#1917

#1924

#1924

#1925

#1926

#1928

#1929

#193

#1932

#1933

#1938

#194

#1942

#1943

#1944

#1945

#1947

#195

#1952

#1952

#1953

#1964

#1965

#1966

#1969

#1969

#1970

#1973

#1973

#1978

#1980

#1981

#1982

#1983

#1990

#1990

#1994

#1997

#1998

#20

#2000

#2001

#2004

#2005

#2005

#201

#2012

#2019

#2020

#2024

#2025

#2026

#203

#203

#2043

#2044

#2045

#2048

#2049

#2054

#2058

#2063

#2068

#2068

#2069

#2070

#2071

#2071

#2072

#2073

#2075

#2075

#2080

#2086

#2088

#2090

#2094

#2095

#2095

#21

#2100

#2102

#2108

#2115

#2119

#2121

#2123

#2127

#2127

#2128

#2129

#2133

#2138

#2142

#2152

#2153

#2154

#2166

#2170

#2181

#2182

#2184

#2184

#2189

#2194

#2196

#2198

#2206

#2208

#2217

#222

#2220

#2227

#2231

#2232

#2234

#2235

#2236

#2237

#2238

#2239

#224

#2240

#2242

#2254

#2254

#2256

#2261

#2264

#2266

#2267

#2270

#2272

#2272

#2279

#228

#2288

#229

#2290

#2291

#2294

#2299

#23

#230

#2302

#231

#2311

#2324

#2330

#2336

#2339

#2342

#2343

#2346

#2350

#2358

#2360

#2367

#2369

#2376

#2382

#2383

#2384

#2386

#2387

#239

#2391

#2393

#2396

#24

#2401

#2406

#2406

#2407

#2410

#2414

#2416

#2417

#2419

#2424

#2425

#2427

#2429

#2431

#2432

#2432

#2433

#2440

#2443

#2444

#2449

#245

#2451

#2455

#2464

#2475

#2477

#2481

#2484

#2485

#2488

#2489

#2495

#2505

#2506

#2511

#2515

#2516

#2517

#2518

#2519

#252

#2523

#2525

#2528

#2529

#253

#2534

#254

#2543

#2546

#2547

#2548

#2549

#2550

#2551

#2555

#2560

#2561

#2562

#2567

#2569

#257

#2570

#2573

#2574

#2576

#2577

#2577

#2579

#2580

#2585

#2589

#2593

#2593

#260

#2604

#2608

#2611

#2613

#2617

#2623

#2624

#2625

#2629

#2633

#2634

#2634

#2635

#2637

#2638

#2639

#2641

#2642

#2643

#2648

#2649

#2653

#2654

#2656

#2659

#2663

#2664

#2670

#2674

#2676

#2683

#2684

#2686

#2687

#2690

#2690

#2691

#2691

#2692

#2693

#2694

#2694

#2699

#27

#2700

#2707

#2709

#271

#2711

#2716

#2718

#2728

#273

#2734

#2736

#2737

#274

#2745

#2749

#2756

#2759

#2760

#2769

#2769

#277

#2770

#2777

#2779

#2790

#2796

#2797

#2799

#28

#2800

#2800

#2816

#282

#2821

#2822

#2824

#2826

#2826

#2831

#2831

#2832

#2832

#2836

#2838

#2838

#284

#284

#2840

#2842

#2842

#2843

#2844

#2845

#2846

#285

#2851

#2853

#2855

#2858

#286

#2862

#2863

#2868

#287

#2873

#2875

#2876

#2877

#2878

#2879

#288

#2880

#2882

#2887

#2889

#2891

#2893

#2895

#2896

#29

#2900

#2902

#2904

#2905

#2908

#291

#2910

#2911

#2912

#2914

#2915

#2916

#2918

#2919

#2921

#2923

#2924

#2925

#2932

#2935

#2937

#2938

#2939

#294

#2941

#2942

#2943

#2945

#2946

#2947

#2948

#2949

#2951

#2952

#2953

#2955

#2956

#2958

#2959

#296

#2960

#2962

#2966

#2968

#2969

#2971

#2972

#2973

#2975

#2976

#2977

#2979

#298

#2981

#2985

#2986

#2987

#2988

#299

#2990

#2991

#2992

#2993

#2994

#2997

#2999

#3

#3000

#3001

#3002

#3004

#3005

#3006

#3007

#301

#3016

#302

#3021

#3022

#3024

#3025

#3027

#3028

#3029

#3031

#3033

#3038

#3042

#3043

#3044

#3045

#3050

#3052

#3054

#3054

#3055

#3056

#3057

#306

#3060

#3062

#3064

#3065

#3068

#3069

#3070

#3071

#3073

#3075

#3076

#308

#3082

#3083

#3084

#3085

#3086

#3087

#3090

#3097

#3098

#31

#3100

#3101

#3102

#3103

#3104

#3106

#3108

#3109

#3112

#3114

#3120

#3124

#3125

#3126

#3127

#3130

#3131

#3132

#3133

#3134

#3136

#3138

#3140

#3141

#3142

#3143

#3145

#3147

#3148

#3149

#3150

#3151

#3152

#3156

#3157

#3158

#3160

#3160

#3163

#3164

#317

#3170

#3171

#3172

#3173

#3175

#3177

#3178

#3179

#318

#3180

#3181

#3183

#3184

#3185

#3186

#3187

#3189

#319

#3190

#3191

#3192

#3193

#3195

#3196

#3197

#3199

#320

#3200

#3201

#3202

#3203

#3206

#3208

#3209

#3214

#3215

#3217

#3218

#3219

#322

#3220

#3221

#3222

#3223

#3223

#3229

#323

#3230

#3231

#3233

#3234

#3237

#3239

#324

#3241

#3242

#3243

#3244

#3245

#3246

#3247

#3251

#3255

#3257

#3257

#3261

#3262

#3264

#3265

#3266

#3268

#3270

#3272

#3273

#3274

#3274

#3275

#3276

#3277

#3281

#3282

#3283

#3284

#3287

#3288

#3289

#3291

#3291

#3292

#3294

#3296

#3298

#3298

#3300

#3301

#3307

#331

#3310

#3313

#3313

#3318

#3319

#3321

#3321

#3322

#3323

#3324

#3325

#3325

#3327

#3328

#3329

#3332

#3333

#3336

#3342

#3346

#3349

#3350

#3354

#336

#3363

#3365

#3369

#3371

#3372

#3374

#3374

#3378

#3378

#3379

#3381

#3383

#3387

#3387

#3389

#3394

#3395

#34

#340

#3401

#3401

#3406

#3408

#3409

#3412

#3412

#3416

#3417

#3417

#3419

#3422

#3422

#3423

#3425

#3426

#3428

#343

#343

#3430

#3430

#3433

#3433

#3436

#3437

#3438

#3439

#3441

#3442

#3443

#3445

#3447

#3448

#345

#3453

#3456

#3457

#3457

#346

#3461

#3462

#3462

#3463

#3466

#3467

#3468

#3468

#3469

#3470

#3471

#3471

#3472

#3473

#3474

#3474

#3477

#3478

#3482

#3483

#3484

#3485

#3485

#3487

#3488

#3489

#3489

#349

#3490

#3492

#3494

#3494

#3495

#3495

#3496

#3498

#350

#3502

#3502

#3503

#3505

#3505

#3506

#3506

#3507

#351

#3513

#3514

#3516

#3518

#3519

#3522

#3524

#3526

#3527

#3527

#3528

#3529

#3529

#353

#3532

#3533

#3534

#3535

#3540

#3540

#3543

#3543

#3555

#3555

#3557

#3558

#3559

#3563

#3564

#3565

#3565

#3566

#3568

#3569

#357

#3572

#3573

#3575

#3578

#3578

#3579

#3580

#3581

#3582

#3582

#3583

#3585

#3587

#3587

#3588

#3588

#3589

#3589

#359

#3590

#3591

#3592

#3593

#3594

#3594

#3598

#3598

#3599

#3599

#36

#3600

#3605

#3605

#3606

#3608

#3610

#3610

#3612

#3612

#3615

#3615

#3616

#3616

#3617

#3617

#3619

#3619

#362

#3621

#3624

#3625

#3625

#3626

#3626

#3630

#3632

#3632

#3633

#3636

#3637

#3637

#3638

#3638

#3639

#3641

#3641

#3644

#3646

#3647

#3649

#365

#3650

#3650

#3652

#3653

#3653

#3655

#3656

#3656

#3658

#366

#3660

#3660

#3661

#3661

#3665

#3668

#3670

#3671

#3672

#3675

#3677

#3678

#3679

#368

#3684

#3685

#3686

#3686

#3689

#369

#3691

#3691

#3693

#3696

#3696

#3699

#3699

#3703

#3704

#3704

#3705

#3707

#3709

#3709

#3710

#3711

#3713

#3714

#3714

#3715

#3716

#3716

#3719

#3719

#3727

#3730

#3732

#3732

#3735

#3742

#3742

#3748

#3748

#3751

#3755

#3755

#3756

#3757

#3757

#3762

#3763

#3764

#3765

#3766

#3767

#3768

#3768

#3769

#3770

#3770

#3775

#3776

#3780

#3780

#3781

#3782

#3783

#3784

#3785

#3786

#3789

#379

#3790

#3797

#3798

#38

#3803

#3805

#3808

#381

#3810

#3811

#3812

#3813

#3813

#3815

#3816

#3816

#3818

#3822

#3822

#3823

#3824

#3826

#3827

#3828

#3829

#383

#3830

#3831

#3832

#3833

#3834

#3835

#3837

#384

#3840

#3842

#3846

#3847

#3848

#3848

#3850

#3851

#3854

#3855

#3856

#3857

#3858

#3859

#3860

#3861

#3864

#3864

#3865

#3866

#3867

#3868

#3869

#3869

#387

#3870

#3870

#3872

#3874

#3874

#3875

#3878

#388

#3880

#3881

#3883

#3885

#3886

#3891

#3892

#3893

#3894

#3896

#3897

#3899

#390

#3900

#3904

#3904

#3905

#3906

#3907

#3908

#3909

#3909

#391

#3910

#3911

#3911

#3912

#3913

#3915

#3916

#3919

#3920

#3921

#3922

#3922

#3925

#3925

#3926

#3926

#3929

#3929

#3931

#3934

#3934

#3936

#3938

#3939

#3939

#3940

#3941

#3941

#3945

#3945

#3946

#3947

#3948

#3948

#3950

#3956

#3957

#3959

#3962

#3963

#3964

#3964

#3966

#3969

#3970

#3972

#3975

#3976

#3976

#3977

#3979

#398

#3980

#3980

#3981

#3982

#3985

#3987

#3987

#3989

#3990

#3991

#3994

#3996

#3997

#3998

#3999

#4000

#4001

#4002

#4003

#4004

#4005

#4006

#4007

#4008

#4009

#4010

#4012

#4013

#4015

#4016

#4017

#4019

#4020

#4020

#4021

#4021

#4022

#4023

#4023

#4025

#4028

#4028

#4029

#4031

#4032

#4033

#4033

#4034

#4035

#4038

#404

#4040

#4044

#4045

#4047

#4048

#4049

#4049

#4050

#4051

#4052

#4053

#4054

#4054

#4055

#4055

#4056

#4057

#4058

#4060

#4061

#4064

#4065

#4066

#4066

#4068

#4068

#4069

#4070

#4072

#4073

#4074

#4077

#4079

#4080

#4082

#4083

#4086

#4086

#4087

#4087

#4089

#4089

#409

#4091

#4095

#4095

#4096

#4097

#4099

#4099

#41

#4100

#4100

#4101

#4102

#4105

#4107

#4108

#4111

#4115

#4115

#4117

#4117

#4119

#4120

#4120

#4121

#4121

#4122

#4122

#4123

#4123

#4124

#4124

#415

#42

#424

#425

#43

#431

#435

#436

#439

#443

#444

#446

#451

#453

#454

#454

#455

#456

#459

#461

#462

#468

#473

#474

#476

#482

#484

#485

#486

#494

#495

#497

#500

#501

#502

#502

#503

#506

#515

#520

#523

#532

#534

#537

#538

#540

#542

#552

#563

#566

#569

#572

#576

#58

#583

#60

#600

#605

#613

#613

#615

#619

#624

#624

#626

#627

#628

#629

#629

#638

#640

#642

#645

#648

#649

#650

#650

#659

#659

#664

#668

#67

#677

#682

#685

#686

#687

#688

#697

#70

#704

#706

#710

#711

#712

#716

#718

#72

#720

#721

#725

#728

#733

#737

#739

#740

#755

#759

#760

#763

#764

#768

#77

#776

#78

#798

#81

#810

#811

#812

#815

#816

#832

#833

#834

#835

#836

#837

#842

#845

#853

#854

#862

#863

#867

#87

#871

#871

#874

#875

#883

#885

#890

#891

#893

#899

#902

#908

#910

#915

#926

#927

#931

#935

#939

#939

#94

#944

#95

#956

#964

#968

#968

#971

#971

#972

#995

0.0.5-3

0.0.6-1

1.0.3

1.0.4

1.1.0

1.4.1-1

1.4.1-2

1.5.2

b2250

b2251

b2252

b2253

b2254

b2257

b2258

b2259

b2260

b2261

b2262

b2263

b2266

b2267

b2268

b2269

b2270

b2271

b2273

b2274

b2275

b2276

b2279

b2280

b2339

b2340

b2341

b2342

b2348

b2349

b2350

b2351

b2352

b2353

b2362

b2364

b2365

b4938

b5127

b5130

b5454

danbev-java-jar-artifact-test

danbev-testing-xcframework-release

v1.0.4

v1.1.0

v1.1.1

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.4.1

v1.4.2

v1.4.3

v1.5.0

v1.5.1

v1.5.2

v1.5.3

v1.5.4

v1.5.5

v1.6.0

v1.6.1

v1.6.2

v1.7.0

v1.7.1

v1.7.2

v1.7.2-pre

v1.7.3

v1.7.3-pre

v1.7.4

v1.7.4-pre-0

v1.7.4-pre-1

v1.7.5

v1.7.6

v1.8.0

v1.8.1

v1.8.2

v1.8.3

v1.8.4

v1.8.5

v1.8.6

v1.8.7

v1.9.0

v1.9.1

v1.9.2

v1.9.3

v1.9.4

v1.9.5

Mono Color

• 43f2c1ff54 vulkan: fix validation issue introduced by #16868 (llama/17145) Ruben Ortlam 2025-11-10 16:59:10 +01:00
• bb92c79f56 metal : enable tensor API for A19 (llama/17087) Georgi Gerganov 2025-11-10 15:38:42 +02:00
• 4fea91f06e arm64: add i8mm route with SVE ggml_vec_dot_q4_K_q8_K and ggml_vec_dot_q6_K_… (#15277) fj-y-saitoandGeorgi Gerganov 2025-11-10 22:12:59 +09:00
• 58a97d988f cuda/vulkan : bicubic interpolation (llama/17022) Acly 2025-11-10 10:19:39 +01:00
• 2e04e7a906 vulkan: fix memory allocations (llama/17122) Ruben Ortlam 2025-11-09 16:14:41 +01:00
• 27f485a14c vad : Silero VAD v6.2.0 (#3524) KITAITI Makoto 2025-11-17 22:26:17 +09:00
• d9b7613b34 ruby : VAD separately from ASR (#3518) KITAITI Makoto 2025-11-13 10:15:26 +09:00
• a1867e0dad sync : llama.cpp Georgi Gerganov 2025-11-09 22:01:21 +02:00
• e67dfbc51b sync : ggml Georgi Gerganov 2025-11-09 18:49:56 +02:00
• 1993e397bb vulkan: iGPU memory reporting fix (llama/17110) Ruben OrtlamandGiuseppe Scrivano 2025-11-09 09:54:47 +01:00
• ee8349cf10 vulkan: fix mmq out of bounds reads (llama/17108) Ruben Ortlam 2025-11-09 09:52:57 +01:00
• db98e8c5b4 vulkan: fuse mul_mat_id + mul (llama/17095) Jeff Bolz 2025-11-09 02:48:42 -06:00
• a4339e2ea7 metal : retain src and dst buffers during async ops (llama/17101) Georgi Gerganov 2025-11-09 08:28:51 +02:00
• 6de3404773 vulkan: Use spec constants for conv2d s/d/p and kernel W/H (llama/16978) Jeff Bolz 2025-11-08 13:24:29 -06:00
• 8967c9ad9b Revert "CUDA: add expert reduce kernel (ggml/16857)" (llama/17100) Aman Gupta 2025-11-08 21:05:19 +08:00
• 522b9bce33 CUDA: skip fusion for repeating adds in bias (llama/17080) Aman Gupta 2025-11-08 16:58:05 +08:00
• 0caa32c772 vulkan: Increase BK to 32; use BK/4 for non-CM mul_mm.comp (llama/16636) SavicStefanandStefan Savic 2025-11-08 09:28:22 +01:00
• 3c975ad523 ggml: disable vxe for cross-compilation by default (llama/16966) Aleksei Nikiforov 2025-11-08 09:00:20 +01:00
• 257ce2f5c0 vulkan: fuse rms_norm + mul + rope (+ view + set_rows) (llama/16977) Jeff Bolz 2025-11-08 01:52:15 -06:00
• 4eef518167 vulkan: Fix test-thread-safety crashes (llama/17024) Jeff Bolz 2025-11-08 01:39:45 -06:00
• 358f77aca7 CUDA: fix MMQ stream-k fixup ne1 indices (llama/17089) Johannes Gäßler 2025-11-08 08:26:18 +01:00
• 78ea6c5b67 ggml webgpu: faster matrix multiplication/matrix-vector multiplication (llama/17031) Reese Levine 2025-11-07 19:27:20 -08:00
• 547724b0a5 CUDA: properly handle nb00=nb02 case for cpy (llama/17081) bssrdf 2025-11-07 17:41:58 -05:00
• 11543bf446 vulkan : refactor buffer handling in vk_op_f32 (llama/16840) Acly 2025-11-07 21:08:50 +01:00
• af8a88792f CUDA: fix should_use_mmvf for ne11 == 1 (llama/17085) Johannes GäßlerandAman Gupta 2025-11-07 20:53:14 +01:00
• a1746097bc Revert "ggml-cpu: detect correct cpu flags for arm64 (llama/16229) (#16239)" (llama/17084) Adrien Gallouët 2025-11-07 17:34:05 +01:00
• 512592513c ggml-cpu: detect correct cpu flags for arm64 (ggml/16229) (llama/16239) ironandlizhenneng 2025-11-08 00:18:14 +08:00
• 5bce732795 ggml-cpu : optimize RVV q2_k and q3_k kernels (llama/16887) xctan 2025-11-07 00:12:45 +08:00
• b5d6fa438f CUDA: fix crash on uneven context without FA (llama/16988) Johannes Gäßler 2025-11-06 14:05:47 +01:00
• 32ed574370 metal : initial Metal4 tensor API support (llama/16634) Georgi Gerganov 2025-11-06 14:45:10 +02:00
• 45588b272e sycl: add CONCAT operator support (llama/16047) YehuditEandSigbjørn Skjæret 2025-11-06 12:02:33 +02:00
• b3324ae7d1 ggml-hexagon: graceful fallback for older socs where rpcmem_alloc2 and FASTRPC_GET_URI is unsupported (llama/16987) l3utterfly 2025-11-06 13:46:38 +08:00
• 13cd906501 improve CUDA cpy memory bandwidth when copying transposed tensor (llama/16841) bssrdfandbssrdf 2025-11-05 15:55:04 -05:00
• 558a04c9c7 vulkan: Fix GGML_VULKAN_CHECK_RESULTS to better handle fusion (llama/16919) Jeff Bolz 2025-11-05 12:51:03 -06:00
• e734b5d6ef ggml webgpu: minor set rows optimization (llama/16810) 4 people 2025-11-09 14:44:39 +02:00
• 44e77ccee6 refactor: replace sprintf with snprintf for safer string handling in dump functions (llama/16913) nullname 2025-11-05 04:25:39 +08:00
• 1672d41ab0 vulkan: remove the need for the dryrun (llama/16826) Jeff Bolz 2025-11-04 13:28:17 -06:00
• 997fdde0c4 ggml-cpu : bicubic interpolation (llama/16891) Acly 2025-11-04 13:12:20 +01:00
• 52e43a2fa5 Fix garbled output with REPACK at high thread counts (llama/16956) NoahandGeorgi Gerganov 2025-11-04 05:04:59 +00:00
• e51a2f90fe CUDA: avoid mul + bias fusion when doing fusion (llama/16935) Aman Gupta 2025-11-04 10:53:48 +08:00
• f856023f46 opencl: support imrope (llama/16914) lhez 2025-11-03 11:47:57 -08:00
• 82ede64cd0 ggml: CUDA: add head size 72 for flash-attn (llama/16962) theo77186 2025-11-03 14:29:11 +01:00
• 79801188f7 ggml : LoongArch fixes (llama/16958) Jinyang He 2025-11-03 14:40:02 +08:00
• f1da026bb8 SYCL: optimized repeat_back kernel (3× fewer asm instructions, 2× faster)Feature/sycl repeat back opt (#16869) shani-f 2025-11-03 03:35:33 +02:00
• 39834fde1b clip : use FA (llama/16837) Georgi GerganovandXuan Son Nguyen 2025-11-02 22:21:48 +02:00
• 5ed97df483 CUDA: add FLOOR, CEIL, ROUND, TRUNC unary ops (llama/16917) mnehete32 2025-11-02 08:42:57 +05:30
• 84854d246a ggml: add s390x cpu-feats (llama/16774) Aaron Teo 2025-11-02 08:48:23 +08:00
• 2001457367 vulkan: Fix multi_add invalid descriptor usage (llama/16899) Jeff Bolz 2025-11-01 00:52:14 -05:00
• 90be9c9de1 vulkan: fuse mul_mat+add and mul_mat_id+add_id (llama/16868) Jeff BolzandSigbjørn Skjæret 2025-11-01 00:45:28 -05:00
• 7d55fba06f CUDA: Remove unneded bias/gate dims in fused mmvq (llama/16858) Oliver SimonsandJohannes Gäßler 2025-11-01 06:13:26 +01:00
• 52e1bbb554 CUDA: Volta tensor core support for MMF (llama/16843) Johannes GäßlerandAman Gupta 2025-10-31 15:57:19 +01:00
• addda802dd ggml : fix conv2d_dw SVE path (ggml/1380) 3 people 2025-11-04 20:40:52 +02:00
• 7d60b431a5 CUDA: add expert reduce kernel (llama/16857) Aman GuptaandJohannes Gäßler 2025-10-31 20:05:07 +08:00
• a9ba988e56 vulkan: disable spirv-opt for rope shaders (llama/16872) Jeff Bolz 2025-10-31 02:34:47 -05:00
• e2b3eca0dc vulkan: Fix crash when FP16 mul_mat accumulation is not supported (llama/16796) Masato Nakasaka 2025-10-31 16:18:59 +09:00
• 7ed570ee94 vulkan: fix shmem overrun in mmq id shader (llama/16873) Ruben OrtlamandGeorgi Gerganov 2025-10-31 08:14:49 +01:00
• 486d39c2cb ggml-hexagon: respect input size when getting/setting tensor data (llama/16836) l3utterfly 2025-10-31 12:46:31 +08:00
• 7fdd53ac0d opencl: fix boundary handling for mul_mm (llama/16875) lhez 2025-10-30 16:00:20 -07:00
• ffe1c832bd cpu: introduce chunking for repack matmuls and enable matmul-id chunking on ARM64 (llama/16833) Max Krasnyansky 2025-10-30 09:06:13 -07:00
• e1780b209d model: add support for qwen3vl series (llama/16780) 7 people 2025-10-30 23:19:14 +08:00
• f1fdb91e95 cpu: introduce chunking for flash attention (llama/16829) Max Krasnyansky 2025-10-30 05:26:05 -07:00
• f7dfa39104 cuda : fix argsort with 64k+ rows (llama/16849) Sigbjørn Skjæret 2025-10-30 08:56:28 +01:00
• 887d984558 vulkan: Handle argsort with a large number of rows (llama/16851) Jeff Bolz 2025-10-30 01:27:41 -05:00
• 41f4daca57 Hide latency of bias and gate-loading (llama/16847) Oliver Simons 2025-10-30 04:34:15 +01:00
• efe8099268 vulkan: Fuse rope+set_rows (llama/16769) Jeff Bolz 2025-10-29 15:13:10 -05:00
• 35a3fda240 vulkan: Update topk_moe fusion to handle gpt's late softmax (llama/16656) Jeff BolzandDiego Devesa 2025-10-29 08:44:29 -05:00
• bc944bddc8 Vulkan MMQ Integer Dot Refactor and K-Quant support (llama/16536) Ruben Ortlam 2025-10-29 14:39:03 +01:00
• 4d74160c9a Hexagon Op queue & dispatch optimizations (llama/16820) Max Krasnyansky 2025-10-29 06:29:12 -07:00
• 6051c704a0 CUDA: use fastdiv in set-rows (llama/16834) Aman Gupta 2025-10-29 21:11:53 +08:00
• 82a23ca9c4 vulkan: Call ggml_vk_buffer_write_2d from ggml_vk_buffer_copy (llama/16793) Jeff Bolz 2025-10-29 03:53:04 -05:00
• 5c316c48f7 CUDA: Fix bug in topk-moe for gpt-oss (llama/16821) Aman Gupta 2025-10-29 15:55:06 +08:00
• 5850c952e5 sycl: add RMS_NORM_BACK operation support (llama/16808) YaelLogicandNeo Zhang Jianyu 2025-10-29 08:14:39 +02:00
• a983c9219d cuda: add SET operation support (llama/16804) YaelGitAccountandSigbjørn Skjæret 2025-10-28 21:10:28 +02:00
• f863a42d97 initialise buffer.device in ggml_hexagon_session (llama/16816) l3utterfly 2025-10-28 23:16:20 +08:00
• cb39359e7f CANN: Improve device ID handling and aclnnArange checks (llama/16752) Chenguang Li 2025-10-28 10:54:53 +08:00
• 0c8ff48103 CUDA: add unused vars to mmvf and mmvq (llama/16807) Aman Gupta 2025-10-28 10:31:21 +08:00
• 9664420a54 sycl: add SSM_CONV operation support (llama/16800) tamarPalandtamarPal 2025-10-28 03:50:33 +02:00
• bcda7c3e58 ggml : fix interpolate with align-corners and ne=1 (llama/16700) Acly 2025-10-27 21:50:22 +01:00
• 1471b1fda7 HIP: fix AMDGPU_TARGETS, update documentation (llama/16803) Johannes Gäßler 2025-10-27 21:39:49 +01:00
• 0e1b6c5fc4 sycl: add ROLL operation support (llama/16665) tamarPalandtamarPal 2025-10-27 03:20:24 +02:00
• 543221d824 sycl: add REPEAT_BACK operation support (llama/16734) shani-fandSigbjørn Skjæret 2025-10-27 03:19:50 +02:00
• 97c3285cc4 CUDA: support for weight clamp in top-k norm (llama/16702) Aman Gupta 2025-10-27 09:06:16 +08:00
• bd8734c050 ggml-alloc : make gallocr prefer chunks that allow memory reuse (llama/16788) Acly 2025-10-26 23:19:03 +01:00
• e6ff2bceed cuda : use fast copy when src and dst are of different type and contiguous (llama/16789) Sigbjørn Skjæret 2025-10-26 21:31:41 +01:00
• 4f4246dcb4 ggml: fix cuda kernel launch configuration for k_compute_batched_ptrs to support large batch (llama/16744) leejetandJohannes Gäßler 2025-10-27 02:13:31 +08:00
• 9f75cc7eef CUDA: General GEMV fusion (llama/16715) Aman Gupta 2025-10-26 19:28:04 +08:00
• c00ab7e5e6 vulkan: deduplicate Microsoft Direct3D12 devices (llama/16689) Gilad S 2025-10-26 06:37:38 +02:00
• d0b544da70 vulkan: delete dead code (llama/16732) Giuseppe Scrivano 2025-10-25 10:59:54 +02:00
• 070b24f65c vulkan: Optimize SSM_SCAN (llama/16645) Jeff Bolz 2025-10-25 00:04:12 -05:00
• 5166efa7f0 ggml: fix CUDA grid launch condition for large block_nums.y in binbcast (llama/16742) leejet 2025-10-25 03:39:37 +08:00
• 524046d4d1 CUDA: use CUB for arbitary size argsort (llama/16754) Aman Gupta 2025-10-24 20:46:19 +08:00
• 47efc4f115 ggml-cuda: use passed ops instead of hardcoded ops (llama/16712) Aman Gupta 2025-10-23 19:14:06 +08:00
• 0a5b4c2e9b sycl: use async memory allocation to fix crashes during graph recording (llama/16644) Matthew Michel 2025-10-22 20:05:15 -05:00
• 8bb12395fe Add experimental ggml-hexagon backend for the Hexagon NPU (llama/16547) 3 people 2025-10-22 13:47:09 -07:00
• a2130ac501 Revert "ggml : Leverage the existing GGML_F32_VEC helpers to vectorize ggml_v…" (#16723) Diego Devesa 2025-10-22 11:20:55 -07:00
• 773041e336 ggml : Leverage the existing GGML_F32_VEC helpers to vectorize ggml_vec_set_f32 for faster fills (llama/16522) sirus20x6andAaron 2025-10-22 05:14:14 -05:00
• 431aaf56f0 CUDA: fix bug in topk-moe softmax (llama/16711) Aman Gupta 2025-10-22 12:33:08 +08:00
• ba41a6ca6a CUDA: topk-moe: add optional parameter for gpt-oss (llama/16649) Aman Gupta 2025-10-21 22:40:38 +08:00
• 99cea274e5 CUDA: better error for FA kernel with 0 occupancy (llama/16643) Johannes Gäßler 2025-10-21 15:27:53 +02:00
• 999a7e0cbf whisper : enable IGPU (#3492) Oleg OrlovandOleg Orlov 2025-11-01 15:38:28 +03:00