-
Notifications
You must be signed in to change notification settings - Fork 2
/
Copy pathevents.html
1240 lines (1042 loc) · 82.7 KB
/
events.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
---
layout: default
nav_active: events
title: Webis Events
description: Overview of events that have been co-organized or co-chaired by Webis
---
<nav class="uk-container">
<ul class="uk-breadcrumb">
<li><a href="index.html">Webis.de</a></li>
<li class="uk-disabled"><a href="#">Events</a></li>
</ul>
</nav>
<main class="uk-section uk-section-default">
<div class="uk-container">
<h1>Events</h1>
<ul class="uk-list">
<li><span data-uk-icon="chevron-down"></span> <a href="#conferences-and-distinguished-workshops">Conferences and Distinguished Workshops</a></li>
<li><span data-uk-icon="chevron-down"></span> <a href="#dagstuhl-seminars">Dagstuhl Seminars</a></li>
<li><span data-uk-icon="chevron-down"></span> <a href="#invited-talks">Invited Talks</a></li>
<li><span data-uk-icon="chevron-down"></span> <a href="#extracurricular-teaching">Extracurricular Teaching</a></li>
<li><span data-uk-icon="chevron-down"></span> <a href="#shared-tasks">Shared Tasks</a></li>
<li><span data-uk-icon="chevron-down"></span> <a href="#pan-research-network">PAN Research Network on Digital Text Forensics</a></li>
<li><span data-uk-icon="chevron-down"></span> <a href="#touche-research-network">Touché Research Network on Computational Argumentation and Causality</a></li>
<li><span data-uk-icon="chevron-down"></span> <a href="#tir-workshop-series">TIR Workshop Series on Information Retrieval</a></li>
<li><span data-uk-icon="chevron-down"></span> <a href="#puk-workshop-series">PuK Workshop Series on Configuration and Design</a></li>
</ul>
</div>
<div class="uk-container uk-margin-medium">
<div id="search-control">
<input type="text" class="uk-input" id="filter-field" placeholder="Type here to filter…"/>
</div>
</div>
<div class="uk-container uk-margin-medium">
<!-- SECTION Conferences and Distinguished Workshops -->
<div class="webis-paragraphs">
<h2><a id="conferences-and-distinguished-workshops"></a>Conferences and Distinguished Workshops</h2>
<a id="webis-christmas-workshop-2024"></a>
<p data-author="johannes kiesel">
<a href="events/webis-christmas-workshop-24/index.html" title="Webis Christmas Workshop 2024">Webis Christmas Workshop 2024</a><br>
Online group event for team building and reflection on the accomplishments of 2024.
</p>
<a id="webis-symposium-2024"></a>
<p data-author="matthias hagen, johannes kiesel, martin potthast, henning wachsmuth">
Webis Symposium 2024<br>
1st International Webis Symposium, held at the Bauhaus-Universität Weimar, program co-chairs Matthias Hagen, Martin Potthast, and Henning Wachsmuth, and local chair Johannes Kiesel. Goal: reflect on the past 20 years of Webis, present current work, and discuss future directions.
</p>
<a id="ratio-2024"></a>
<p data-author="benno stein" data-keywords="ratio">
<a href="https://ratio-conference.net/" title="RATIO Conference 2024">RATIO Conference 2024</a><br>
1st International Conference on Robust Argumentation Machines (RATIO 2024), chaired by Philipp Cimiano, Anette Frank, Michael Kohlhase, and Benno Stein. Goal: promote and discuss progress in the development of argumentation engines that are able to systematically, efficiently, and adequately summarize public debates in the form of arguments, positions, key points, and interest groups.
</p>
<a id="wows-2024"></a>
<p data-author="maik fröbe, martin potthast">
<a href="https://opensearchfoundation.org/wows2024/" title="1st International Workshop on Open Web Search">WOWS</a> @ <a href="https://www.ecir2024.org/" target="_blank">ECIR 2024</a><br>
1st International Workshop on Open Web Search (WOWS 2024), held in conjunction with the 46th European Conference on Information Retrieval (ECIR 2024), co-organized by Sheikh Mastura Farzana, Maik Fröbe, Gijs Hendriksen, Michael Granitzer, Djoerd Hiemstra, Martin Potthast, Saber Zerhoudi. Goal: promote and discuss ideas and approaches to open up the web search ecosystem so that small research groups and young startups can leverage the web to foster an open and diverse search market.
</p>
<a id="scai-2024"></a>
<p data-author="johannes kiesel, maik fröbe">
<a href="https://scai.info/scai-2024/" title="8th Workshop on Search-Oriented Conversational Artificial Intelligence 2024">SCAI</a> @ <a href="https://chiir2024.github.io/" target="_blank">CHIIR 2024</a><br>
8th Workshop on Search-Oriented Conversational Artificial Intelligence (SCAI 2024), held in conjunction with the 9th ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2024), co-organized by Alexander Frummet, Andrea Papenmeier, Maik Fröbe, and Johannes Kiesel. Goal: exploring conversational AI for intelligent information access.
</p>
<a id="clef-2022"></a>
<p data-author="martin potthast">
<a href="https://clef2022.clef-initiative.eu/index.php?page=Pages/labs.html" title="CLEF Labs 2022">CLEF Labs 2022</a><br>
Labs of the 13th Conference and Labs of the Evaluation Forum CLEF, a continuation of the popular CLEF campaigns which have run since 2000, lab chairs Allan Hanbury and Martin Potthast. Goal: contribute to the systematic evaluation of information access systems, primarily through experimentation on shared tasks.
</p>
<a id="tmg-2022"></a>
<p data-author="alexander bondarenko, shahbaz syed">
<a href="https://recap.uni-trier.de/2022-tmg-workshop/" title="Workshop on Text Mining and Generation 2022">TMG</a> @ <a href="https://ki2022.gi.de/" target="_blank">KI 2022</a><br>
1st Workshop on Text Mining and Generation (TMG 2022), held in conjunction with the 45th German Conference on Artifical Intelligence (KI 2022), co-organized by Alexander Bondarenko and Shahbaz Syed. Goal: bridging the gap between text mining (knowledge extraction) and text generation.
</p>
<a id="argmining-2019"></a>
<p data-author="benno stein, henning wachsmuth">
<a href="https://argmining19.webis.de/" title="ArgMining 2019">ArgMining</a> @ <a href="https://acl2019.org/EN/index.xhtml.html" target="_blank">ACL 2019</a><br>
6th Workshop on Argument Mining, held in conjunction with the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019), and chaired by Benno Stein and Henning Wachsmuth. Goal: foster future research and development in the area of computational argument mining.
[<a href="publications.html#stein_2019">proceedings</a>]
</p>
<a id="poda-2018"></a>
<p data-author="tim gollub, benno stein">
<a href="events/poda-18" title="PODA 2018">PODA 2018</a><br>
Algorithmic Discourse Analysis, an interdisciplinary workshop chaired by Henning Schmidgen, Benno Stein, and Frank Simon-Ritz in 2018. Goal: bring together researchers and practitioners from the humanities, computer science, and information science to explore digital methods for the analysis of discourses.
</p>
<a id="clef-2013"></a>
<p data-author="benno stein">
<a href="http://clef2013.clef-initiative.eu/" title="CLEF Conference 2013">CLEF Conference 2013</a><br>
4th Conference and Labs of the Evaluation Forum CLEF, a continuation of the popular CLEF campaigns which have run since 2000, chaired by Paolo Rosso and Benno Stein. Goal: contribute to the systematic evaluation of information access systems, primarily through experimentation on shared tasks.
</p>
</div>
<!-- SECTION Dagstuhl Seminars -->
<div class="webis-paragraphs">
<h2><a id="dagstuhl-seminars"></a>Dagstuhl Seminars</h2>
<a id="dagstuhl-25391"></a>
<p data-author="matthias hagen, martin potthast, benno stein" data-keywords="ir">
<a href="https://www.dagstuhl.de/25391" title="Dagstuhl 25391">Retrieval-Augmented Generation – The Future of Search?</a> @ Schloss Dagstuhl 2025<br>
Dagstuhl Seminar 25391 "Retrieval-Augmented Generation – The Future of Search?", to be organized by Matthias Hagen, Josiane Mothe, Smaranda Muresan, Martin Potthast, Benno Stein, and Min Zhang in 2025. Goal: investigate the expectations, the promises, the potential, and the limits of integrating retrieval-augmented generatoipn (RAG) in information retrieval (IR).
</p>
<a id="dagstuhl-22432"></a>
<p data-author="khalid al-khatib" data-keywords="argumentation">
<a href="https://www.dagstuhl.de/22432" title="Dagstuhl 22432">Towards a Unified Model of Scholarly Argumentation</a> @ Schloss Dagstuhl 2022<br>
Dagstuhl Seminar 22432 "Towards a Unified Model of Scholarly Argumentation", organized by Khalid Al-Khatib, Anita de Waard, Iryna Gurevych, and Yufang Hou in 2022. Goal: Lay the groundwork for a nascent, multidisciplinary community devoted to building and maintaining principles, tools, and models to identify key components in scholarly argumentation.
</p>
<a id="dagstuhl-22131"></a>
<p data-author="benno stein" data-keywords="framing">
<a href="https://www.dagstuhl.de/22131" title="Dagstuhl 22131">Framing in Communication</a> @ Schloss Dagstuhl 2022<br>
Dagstuhl Seminar 22131 "Framing in Communication: From Theories to Computation", organized by Katarzyna Budzynska, Chris Reed, Manfred Stede, and Benno Stein in 2022. Goal: carefully study and assess the various relevant disciplines (sociology, political science, psychology, communication science, and others) to develop (1) a common ground for the computational treatment of framing and (2) a roadmap for the automatic identification of framing in text and speech.
</p>
<a id="dagstuhl-19461"></a>
<p data-author="khalid al-khatib, benno stein" data-keywords="conversational-search">
<a href="https://www.dagstuhl.de/19461" title="Dagstuhl 19461">Conversational Search</a> @ Schloss Dagstuhl 2019<br>
Dagstuhl Seminar 19461 "Conversational Search", organized by Avishek Anand, Hideo Joho, Mark Sanderson, and Benno Stein in 2019. Goal: bring together leading researchers from relevant communities to understand and analyze the promising retrieval paradigm of conversational search and its future from different angles like interactivity, result presentation, clarification, user models, evaluation, and search behavior.
[<a href="publications.html#anand_2020a">report</a>]
</p>
<a id="dagstuhl-15512"></a>
<p data-author="khalid al-khatib, benno stein">
<a href="https://www.dagstuhl.de/15512" title="Dagstuhl 15512">Debating Technologies</a> @ Schloss Dagstuhl 2015<br>
Dagstuhl Seminar 15512 "Debating Technologies", organized by Iryna Gurevych, Eduard H. Hovy, Noam Slonim, and Benno Stein in 2015. Goal: set the grounds for a new interdisciplinary research community, interested in Debating Technologies, defined henceforth as computational technologies developed directly to enhance, support, and engage with human debating.
[<a href="publications.html#gurevych_2016">report</a>]
</p>
<a id="dagstuhl-11171"></a>
<p data-author="tim gollub, benno stein" data-keywords="cair">
<a href="https://www.dagstuhl.de/11171" title="Dagstuhl 11171">Challenges in Document Mining</a> @ Schloss Dagstuhl 2011<br>
Dagstuhl Seminar 11171 "Challenges in Document Mining", organized by Hamish Cunningham, Oren Etzioni, Norbert Fuhr, and Benno Stein in 2011. Goal: bring together researchers from the main areas of document mining to present their views, understand where and how latest disciplinary achievements can be combined, and develop an integrative view on document mining.
[<a href="publications.html#cunningham_2011">report</a>]
</p>
</div>
<!-- SECTION Invited Talks -->
<div class="webis-paragraphs">
<h2><a id="invited-talks"></a>Invited Talks</h2>
<a id="tu-delft-25"></a>
<p data-author="maik fröbe">
Green IR: Measuring and Applications<br>
Maik Fröbe at the Information Retrieval Lecture at TU Delft in March 2025.
[<a href="https://downloads.webis.de/talks/froebe_2025b.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="BTW-fresh-thinking-talks-25"></a>
<p data-author="martin potthast">
Retrieval Technologies for the Infinite Index<br>
Martin Potthast at the <a href="https://web.archive.org/web/20250305200412/https://www.conftool.net/btw2025/index.php?page=browseSessions&path=adminSessions&print=export&ismobile=false&form_session=47">21st Conference on Database Systems for Business, Technology and Web (BTW)</a> in Bamberg in March 2025.
[<a href="https://downloads-cf.webis.de/talks/potthast_2025a.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="ows-webinar-25"></a>
<p data-author="maik fröbe">
Search Components: Development and Evaluation<br>
Maik Fröbe at the Open Web Search Webinar Series in February 2025.
[<a href="https://downloads.webis.de/talks/froebe_2025a.pdf" title="Slides of the talk">slides</a>]
[<a href="https://openwebsearch.eu/community/trainings-webinars/" title="Video of the talk">video</a>]
</p>
<a id="DLR-colloquium-24"></a>
<p data-author="martin potthast" data-keywords="information-nutrition-label, trigger-warning">
Elements of the Information Nutrition Label: Understanding Trigger Warnings<br>
Martin Potthast at the DLR Open Search Colloquium in July 2024.
[<a href="https://downloads.webis.de/talks/potthast_2024c.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="jena-eteach-jahrestagung-24"></a>
<p data-author="johannes kiesel,benno stein">
Understanding to Stay in Control: Using, Assessing, and Mastering AI<br>
Keynote of Benno Stein and Johannes Kiesel at the <a href="https://indico.rz.uni-jena.de/event/133/overview">Jahrestagung des eTeach-Netzwerks Thüringen</a> in Jena in November 2024.
[<a href="https://downloads.webis.de/talks/stein_2024a.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="UK-iteg-welcome-24"></a>
<p data-author="martin potthast">
The Evolution of Web Search<br>
Invited talk at the <a href="https://www.uni-kassel.de/forschung/en/iteg/events/calendar-of-events/event/2024/11/19/the-evolution-of-web-search-vortrag-und-diskussion-mit-prof-dr-martin-potthast?cHash=577b09eb51e5becb0b5ce8dfb32b8f8c">Research Center for Information System Design (ITeG)</a> in Kassel in November 2024.
[<a href="https://downloads.webis.de/talks/potthast_2024b.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="reneuir-24"></a>
<p data-author="maik fröbe">
Overview of the ReNeuIR 2024 Shared Task<br>
Maik Fröbe at the ReNeuIR workshop in Washington in July 2024.
[<a href="https://downloads.webis.de/talks/froebe_2024h.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="arqus-24"></a>
<p data-author="martin potthast">
Generative Search and Biases: Challenges and Opportunities of a New Information Ecology<br>
Martin Potthast at the <a href="https://arqus-alliance.eu/our-communities/our-hubs/arqus-plurilingual-and-intercultural-hub/webinar-series-9-months-9-universities/">Webinar series: 9 Months, 9 Universities</a> of the Arqus Plurilingual and Intercultural Hub in June 2024.
[<a href="https://downloads.webis.de/talks/potthast_2024a.pdf" title="Slides of the talk">slides</a>]
[<a href="https://www.youtube.com/watch?v=GeMyKGH_hC8" title="Video of the talk">video</a>]
</p>
<a id="augsburg-24"></a>
<p data-author="maik fröbe">
TIRA for IR: Theory and Hands-On Tutorial<br>
Maik Fröbe at the IR Lab in Augsburg in June 2024.
[<a href="https://downloads.webis.de/talks/froebe_2024b.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="padua-24"></a>
<p data-author="maik fröbe">
Perspectives on Evaluating Diverse Open Web Search Applications with TIREx<br>
Maik Fröbe at the IR Lab in Padua in March 2024.
[<a href="https://downloads.webis.de/talks/froebe_2024a.pdf" title="Slides of the talk">slides</a>]
[<a href="https://www.youtube.com/watch?v=KFojU7BBd6o&list=PL4yRbSc0b_NoTOxCuKnaVwWdcP0kp914s" title="Video of the talk">video</a>]
</p>
<a id="ir-hackathon-24"></a>
<p data-author="maik fröbe">
Hackathon for The First Workshop on Open Web Search<br>
Maik Fröbe at TU Dresden in April 2024.
[<a href="https://tu-dresden.de/ing/informatik/die-fakultaet/news/information-retrieval-hackathon-an-der-professur-fuer-datenbanken" title="Summary of the hackathon">summary</a>]
</p>
<a id="DNB-fachtagung-23"></a>
<p data-author="martin potthast">
Generative Search and Biases: Challenges and Opportunities of a New Information Ecology<br>
Martin Potthast at the German National Library (DNB) professional event
<a href="https://www.dnb.de/EN/Kulturell/Veranstaltungskalender/Fachveranstaltungen/20231207KiInBibliotheken.html">AI in Libraries: New Pathways with Large Language Models?</a> in Frankfurt in December 2023.
[<a href="https://downloads.webis.de/talks/potthast_2023c.pdf" title="Slides of the talk">slides</a>]
[<a href="https://www.youtube.com/watch?v=SMPCGwOIV8I" title="Video of the talk">video</a>]
</p>
<a id="weimar-feeds-and-flows-23"></a>
<p data-author="niklas deckers">
From Noise to Art: User-Controlled Image Generation Beyond Prompt Engineering<br>
Niklas Deckers at the DFG-funded lecture series
<a href="https://www.uni-weimar.de/en/media/chairs/media-studies/digital-cultures/veranstaltungen/feeds-flows/">Feeds & Flows: Interdisciplinary Perspectives on Ephemeral Image Cultures</a> in Weimar in November 2023.
[<a href="https://downloads.webis.de/talks/deckers_2023.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="jena-digitalgipfel-23"></a>
<p data-author="matthias hagen, martin potthast, benno stein">
Biases and Generative AI<br>
Matthias Hagen, Martin Potthast, and Benno Stein at the BMBF DigitalGipfel in Jena in November 2023.
[<a href="https://downloads.webis.de/talks/hagen_2023.pdf" title="Slides of the talk">slides</a>]
[<a href="https://www.youtube.com/watch?v=dxL7cnNCxOo" title="Video of the talk">video</a>]
</p>
<a id="all-hands-23"></a>
<p data-author="niklas deckers">
Manipulating Embeddings of Stable Diffusion Prompts<br>
Invited poster for the ScaDS.AI delegation at the All Hands Meeting of the German AI competence centers by Niklas Deckers, October 2023.
</p>
<a id="jrc-disinfo-23"></a>
<p data-author="johannes kiesel">
Open Web Search And its Use to Find Arguments Against Populist Claims<br>
Johannes Kiesel at the Joint Research Centre of the European Commission (JRC) Disinformation Workshop in Brussels in September 2023.
[<a href="https://downloads.webis.de/talks/kiesel_2023.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="glasgow-ir-seminar-23b"></a>
<p data-author="harry scells">
Query Automation for Systematic Reviews<br>
Harry Scells at the Glasgow IR Group Seminar in July 2023.
[<a href="https://downloads.webis.de/talks/scells_2023b.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="dlr-open-search-colloquium-23"></a>
<p data-author="benno stein">
Cognitive Biases and Information Retrieval<br>
Benno Stein at the DLR Open Search Colloquium in July 2023.
[<a href="https://downloads.webis.de/talks/stein_2023b.pdf" title="Slides of the talk">slides</a>]
[<a href="https://www.youtube.com/watch?v=kHmo0-3ZkuQ" title="Video of the talk">video</a>]
</p>
<a id="scadsai-state-secretary-visit-23"></a>
<p data-author="martin potthast">
Web Search: The Next Generation<br>
Martin Potthast at the ScaDS.AI State Secretary Visit in June 2023.
[<a href="https://downloads.webis.de/talks/potthast_2023b.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="reneuir-23"></a>
<p data-author="maik fröbe">
TIREx: The Information Retrieval Experiment Platform<br>
Maik Fröbe at the ReNeuIR workshop in Taipei in July 2023.
</p>
<a id="infai-23"></a>
<p data-author="maik fröbe">
Blinded Experiments with TIRA<br>
Maik Fröbe at the Institute for Applied Computer Science in June 2023.
[<a href="https://downloads.webis.de/talks/froebe_2023b.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="hpc-status-conference-23"></a>
<p data-author="martin potthast">
Open Web Search and Web Archive Analytics at Scale<br>
Martin Potthast at the <a href="https://gauss-allianz.de/de/hpc-statuskonferenz-2023">HPC Status Conference 2023</a>. <!-- May 2023-->
[<a href="https://downloads.webis.de/talks/potthast_2023a.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="tmwwdg-23"></a>
<p data-author="benno stein, martin potthast">
Language, Language Models, and ChatGPT<br>
Benno Stein at the Thüringer Ministerium für Wirtschaft, Wissenschaft und Digitale Gesellschaft (TMWWDG) in March 2023.<br>
Martin Potthast at the <a href="https://fdhl.info/language-language-models-and-chatgpt/">ARQUS Forum Digital Humanities</a> and the Final Undimes Project Meeting in 2023.
[<a href="https://downloads.webis.de/talks/stein_2023a.pdf" title="Slides of the talk">slides</a>]
[<a href="https://www.youtube.com/watch?v=Rf0YEEwqz6Y&list=PLgD1TOdHQCI-4RMsrGVJahSUPIfDCFMhy&index=5" title="Video of the talk">video</a>]
</p>
<a id="glasgow-ir-seminar-23a"></a>
<p data-author="maik fröbe">
TIREx: The Information Retrieval Experiment Platform<br>
Maik Fröbe at the Glasgow IR Group Seminar in March 2023.
[<a href="https://downloads.webis.de/talks/froebe_2023a.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="linz-22"></a>
<p data-author="harry scells">
Green Information Retrieval Research<br>
Harry Scells at the University of Linz in January 2023.
[<a href="https://downloads.webis.de/talks/scells_2023a.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="paderborn-data-science-colloquium-22"></a>
<p data-author="benno stein">
IR and NLP Research in the Webis Group<br>
Benno Stein at the Paderborn Data Science Colloquium in December 2022.
[<a href="https://downloads.webis.de/talks/stein_2022c.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="clickbait-22"></a>
<p data-author="maik fröbe">
Clickbait Spoiling at SemEval-2023<br>
Maik Fröbe at TU Dresden (18.10.2022), TH Köln (21.10.2022), Uni Regensburg (26.10.2022), and Uni Leipzig (07.11.2022).
[<a href="https://pan.webis.de/semeval23/pan23-figures/semeval23-clickbait-spoiling-call-for-participation-for-teaching-frame.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="scadsai-general-assembly-22"></a>
<p data-author="martin potthast">
The Treachery of Answers<br>
Martin Potthast at the ScaDS.AI General Assembly in December 2022.
[<a href="https://downloads.webis.de/talks/potthast_2022d.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="lndw-22"></a>
<p data-author="benno stein">
Algorithms for Authorship Analytics<br>
Keynote of Benno Stein at the <a href="https://web.archive.org/web/20221019174925/https://www.weimar.de/fileadmin/Redaktion/Wirtschaft/Dokumente/lndwprogramm2022.pdf">Lange Nacht der Wissenschaften 2022</a> in Weimar. <!-- November 2022 -->
[<a href="https://downloads.webis.de/talks/stein_2022b.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="avh-network-meeting-22"></a>
<p data-author="harry scells">
Finding Answers to Complex Medical Questions<br>
Harry Scells at the Hybrid Network Meeting of the Alexander von Humboldt Foundation in November 2022.
[<a href="https://downloads.webis.de/talks/scells_2022a.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="search-engines-course-padova-22"></a>
<p data-author="christopher schröder, martin potthast">
Touché @ CLEF: Shared Task on Argument Retrieval<br>
Alexander Bondarenko at the Search Engines Course at the University of Padova in 2022.
[<a href="https://downloads.webis.de/talks/bondarenko_2022.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="clef-22"></a>
<p data-author="benno stein">
Perceived Limits in Information Retrieval<br>
Keynote of Benno Stein at the <a href="https://clef2022.clef-initiative.eu/">CLEF 2022 Conference and Labs of the Evaluation Forum</a> in Bologna. <!-- September 2022 -->
[<a href="https://downloads.webis.de/talks/stein_2022a.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="scientific-authorship-and-peer-review-workshop-22"></a>
<p data-author="erik körner">
A new Resource for Analyzing Collaborative Writing Styles and One-Sidedness<br>
Erik Körner at the Scientific Authorship and Peer Review Workshop at the German Center for Higher Education Research and Science Studies in September 2022.
[<a href="https://downloads.webis.de/talks/koerner_2022.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="scientific-authorship-and-peer-review-workshop-22"></a>
<p data-author="victor zimmermann">
Webis-STEREO-21: Exploring Scientific Text Reuse at Scale<br>
Victor Zimmermann at the Scientific Authorship and Peer Review Workshop at the German Center for Higher Education Research and Science Studies in September 2022.
[<a href="https://downloads.webis.de/talks/zimmermann_2022.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="scai-22"></a>
<p data-author="alexander bondarenko">
A User Study on Clarifying Comparative Questions<br>
Alexander Bondarenko at the <a href="https://web.archive.org/web/20221221152343/https://scai.info/">SCAI 2022 Workshop on Search-Oriented Conversational AI</a> in July 2022.
[<a href="https://downloads.webis.de/talks/bondarenko_2022.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="arqus-forum-digital-humanities-22"></a>
<p data-author="martin potthast">
Exploring our Digital Past: Web Archive Analytics<br>
Keynote of Martin Potthast at the <a href="https://fdhl.info/Veranstaltung/arqus-research-focus-forum/?instance_id=103">ARQUS Forum Digital Humanities</a> in June 2022.
[<a href="https://downloads.webis.de/talks/potthast_2022c.pdf" title="Slides of the talk">slides</a>]
[<a href="https://www.youtube.com/watch?v=9tgLqy4EWQY&list=PLgD1TOdHQCI-4RMsrGVJahSUPIfDCFMhy&index=10" title="Video of the talk">video</a>]
</p>
<a id="scadsai-colloquium-22"></a>
<p data-author="niklas deckers">
Investigating and Mitigating Topic Bias in Authorship Attribution<br>
Niklas Deckers at the ScaDS.AI Colloquium in May 2022.
[<a href="https://downloads.webis.de/talks/deckers_2022.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="zih-colloquium-22"></a>
<p data-author="martin potthast">
Web Archive Analytics<br>
Martin Potthast at the <a href="https://tu-dresden.de/zih/die-einrichtung/termine/zih_kolloquium/zih-kolloquien2022">ZIH Colloquium</a> in April 2022.
[<a href="https://downloads.webis.de/talks/potthast_2022b.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="dagstuhl-22131-talk"></a>
<p data-author="arno simons, martin potthast">
Quantifying Luhmann: A Semi-Supervised Approach to Automatic Detection of Social Systems<br>
Arno Simons and Martin Potthast at the <a href="https://webis.de/events.html#dagstuhl-22131">Dagstuhl Seminar 22131 "Framing in Communication: From Theories to Computation"</a> in March 2022.
[<a href="https://downloads.webis.de/talks/potthast_2022a.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="search-engines-course-padova-21"></a>
<p data-author="alexander bondarenko">
Touché @ CLEF: Shared Task on Argument Retrieval<br>
Alexander Bondarenko at the Search Engines Course at the University of Padova in 2021.
[<a href="https://downloads.webis.de/talks/bondarenko_2021.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="dlr-open-search-colloquium-21"></a>
<p data-author="christopher schröder, martin potthast">
Practical Experiences and New Challenges in Web Crawling<br>
Christopher Schröder and Martin Potthast at the DLR Open Search Colloquium in June 2021.
[<a href="https://downloads.webis.de/talks/potthast_2021b.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="stuts-tacos-21"></a>
<p data-author="martin potthast">
Algorithms for the Manipulation of Writing Style<br>
Keynote of Martin Potthast at <a href="https://69.stuts.de/">Joint 69th Student Conference on Linguistics and Computational Linguistics Students Conference 2021</a>. <!-- May 2021 -->
[<a href="https://downloads.webis.de/talks/potthast_2021a.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="imitatoren-des-menschlichen-21"></a>
<p data-author="matthias hagen, martin potthast">
Authorship Analysis and Obfuscation<br>
Matthias Hagen and Martin Potthast at "<a href="https://web.archive.org/web/20210226071006/https://imitatoren-des-menschlichen.de/">Imitatoren des Menschlichen</a>", a talk series of the Institure Groupd of Sociology at Martin-Luther-Universität Halle-Wittenberg in February 2021.
[<a href="https://downloads.webis.de/talks/hagen_2021.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="fmi-christmas-lecture-20"></a>
<p data-author="martin potthast">
Tackling Societal Challenges with Style Analysis<br>
Martin Potthast at the Christmas Lecture 2020 of the Faculty of Mathematics and Computer Science at Leipzig University. <!-- December 2020 -->
[<a href="https://downloads.webis.de/talks/potthast_2020.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="digital-humanities-and-ai-seminar-20"></a>
<p data-author="alexander bondarenko">
ACQuA: Answering Comparative Questions with Arguments<br>
Alexander Bondarenko at the Digital Humanities and AI Seminar at Perm State University in December 2020.
[<a href="https://downloads.webis.de/talks/bondarenko_2020.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="jugend-forscht-ceremony-13"></a>
<p data-author="benno stein">
Über das Forschen<br>
Benno Stein at the Jugend Forscht award ceremony at Erfurt in March 2013.
[<a href="https://downloads.webis.de/talks/stein_2013.pdf" title="Slides of the talk">slides</a>]
</p>
</div>
<!-- SECTION Extracurricular Teaching -->
<div class="webis-paragraphs">
<h2><a id="extracurricular-teaching"></a>Extracurricular Teaching</h2>
<a id="buw-ki-inhouse-seminar-24"></a>
<p data-author="marcel gohsen,johannes kiesel,benno stein">
Using AI in Everyday Life at the University<br>
Internal seminar at the Bauhaus-Universität Weimar by Benno Stein, Johannes Kiesel, and Marcel Gohsen, November 2024.
[<a href="https://downloads.webis.de/talks/stein_2024c.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="buw-kinderuni-24"></a>
<p data-author="johannes kiesel,benno stein">
Wie lernen Computer?<br>
Lecture at the <a href="https://www.kinderuni-weimar.de/">Kinderuni Weimar</a> by Benno Stein and Johannes Kiesel, November 2024.
[<a href="https://downloads.webis.de/talks/stein_2024b.pdf" title="Slides of the talk">slides</a>]
</p>
<a id="tdt-24"></a>
<p data-author="niklas deckers, tim hagen">
Crash course on LLM Research and Paper Writing<br>
Lab for high school students at <a href="https://www.uni-kassel.de/eecs/infothek/veranstaltungen/tag-der-technik">Tag der Technik</a> at University of Kassel hosted by Tim Hagen and Niklas Deckers, 2024.
</p>
<a id="ul-open-day-24"></a>
<p data-author="niklas deckers">
Introduction to Chain-of-Thought Prompting<br>
Talk at the Leipzig University Open Day by Niklas Deckers, 2024.
</p>
<a id="scads-studienstiftung-alumni-23"></a>
<p data-author="niklas deckers">
Generative Text-To-Image Models<br>
Talk at a ScaDS.AI Living Lab event for alumni of the German Academic Scholarship Foundation by Niklas Deckers, 2023.
</p>
<a id="scads-studium-universale-23"></a>
<p data-author="niklas deckers">
Solving Complex Problems Using Language Models<br>
Interactive session on Chain-of-Thought Prompting at the Leipzig University Studium Universale "Creative AI Breakfast" by Niklas Deckers, 2023.
</p>
<a id="scads-lndw-23"></a>
<p data-author="niklas deckers">
Prompting Text-To-Image Models and Chain-of-Thought Prompting<br>
Two talks and two demonstrators at the Leipzig <a href="https://web.archive.org/web/20230613153511/https:/www.wissen-in-leipzig.de/programm-nach-orten/kompetenzzentrum-fuer-kuenstliche-intelligenz-scadsai-dresden-leipzig/">Lange Nacht der Wissenschaften</a> by Niklas Deckers, 2023.
</p>
<a id="lightboard-23"></a>
<p data-author="niklas deckers">
Exchange of Experiences and Discussion About the Use of Lightboards in Teaching<br>
Talks at Leipzig University for the E-Learning Team and at the Tag der Lehre by Niklas Deckers, 2023.
[<a href="events/lightboard-23/lightboard-23-slides.pdf" title="Lightboard presentation slides">slides</a>]
</p>
<a id="weights-and-biases-2023"></a>
<p data-author="niklas deckers">
Weights & Biases Event on Reproducibility, Hyperparameter Optimization and Evaluation<br>
Tutorial by Ayush Thakur, ML engineer at Weights & Biases, co-hosted by Niklas Deckers, 2023.
[<a href="events/weights-and-biases-2023/weights-and-biases-2023-slides.pdf" title="Weights & Biases presentation slides">slides</a>]
</p>
<a id="scads-studienstiftung-22"></a>
<p data-author="niklas deckers">
Keynote about the current progress in Generative Models and ongoing research approaches <br>
Talk at a ScaDS.AI Living Lab symposium with members of the German Academic Scholarship Foundation by Niklas Deckers, 2022.
</p>
<a id="scads-handson-22"></a>
<p data-author="niklas deckers">
Stable Diffusion: AI-generated images <br>
Hands-on session at ScaDS.AI hosted by Niklas Deckers, 2022.
</p>
<a id="tutorial-prompt-engineering-2022"></a>
<p data-author="niklas deckers">
Introduction to Prompt Engineering: Strategies and Examples @ ScaDS.AI 2022<br>
Research tutorial and seminar at the Center for Scalable Data Analytics and Artificial Intelligence, Leipzig, held by Niklas Deckers.
</p>
<a id="huggingface-workshop-22"></a>
<p data-author="christopher akiki">
ML Demo.cratization Tour with Hugging Face 2022<br>
Introduction to the Hugging Face ecosystem and tutorial on the creation of shareable machine learning apps, organized by Christopher Akiki, held by Omar Espejel from Hugging Face.
</p>
<a id="tutorial-ki-2020"></a>
<p data-author="benno stein">
<a href="https://spp-ratio.de/events/ki-tutorial-21-25-sep-2020/" title="Argumentation Technology">Argumentation Technology</a> @ KI 2020<br>
Tutorial "Argumentation Technology", organized by Philipp Cimiano, Henning Wachsmuth, Khalid Al-Kathib, and Benno Stein in 2020.
Goal: outline the importance of argumentation for artificial intelligence while putting the focus on three important fields within computational argumentation: argumentation mining, argumentation retrieval, and argumentation synthesis.
</p>
<a id="tutorial-ki-2019"></a>
<p data-author="benno stein">
<a href="https://spp-ratio.de/events/ki-tutorial-september-2019/" title="Argumentation Technology">Argumentation Technology</a> @ KI 2019<br>
Tutorial "Argumentation Technology", organized by Philipp Cimiano, Henning Wachsmuth, and Benno Stein in 2019.
Goal: outline the importance of argumentation for artificial intelligence while putting the focus on three important fields within computational argumentation: argumentation mining, argumentation retrieval, and argumentation synthesis.
</p>
<a id="studienstiftung-2017-2019"></a>
<p data-author="matthias hagen, martin potthast, benno stein">
Stylometry and Paraphrasing @ Studienstiftung des deutschen Volkes 2017 - 2019<br>
Research Training Group "Stylometry and Paraphrasing", organized by Matthias Hagen, Martin Potthast, Benno Stein, and Efstathios Stamatatos.
Funded by the Studienstiftung des deutschen Volkes within the natural sciences and engineering program and organized as week-long retreats in Cologne (2017), Heidelberg (2018), Weimar (2018), and Springe (2019).
Goal: theoretical and practical analysis of the state of the art in authorship analytics and development of new authorship verification approaches based on deep learning and phonetic analyses.
</p>
<a id="studienstiftung-2018"></a>
<p data-author="johannes kiesel, martin potthast">
Setting the News Straight Through Technology @ Studienstiftung des deutschen Volkes 2018<br>
Workshop "Fake News Detection Technology", organized by Matthias Hagen, Johannes Kiesel, and Martin Potthast in 2018.
Goal: joint work on technology to detect clickbait and hyperpartisan news as well as retrieval technology to search police press releases and arguments.
</p>
<a id="studienstiftung-2017"></a>
<p data-author="martin potthast">
<a href="https://web.archive.org/web/20170706225955/https://technologie-gesellschaft.de/" title="Conference Technology & Society">Writing Style and Anonymity</a> @ Studienstiftung des deutschen Volkes 2017<br>
Workshop "Writing Style and Anonymity" (Schreibstil und Anonymität), organized by Martin Potthast in 2017.
Goal: discuss current capabilities of technologies to manipulate writing style and possible repercussions on society of future applications.
</p>
<a id="tutorial-acl-2016"></a>
<p data-author="benno stein">
<a href="http://acl2016tutorial.arg.tech/" title="NLP Approaches to Computational Argumentation">NLP Approaches to Computational Argumentation</a> @ ACL 2016<br>
Tutorial "NLP Approaches to Computational Argumentation", organized by Noam Slonim, Iryna Gurevych, Chris Reed, and Benno Stein at the 54th Annual Meeting of the Association for Computational Linguistics (ACL 2016).
Goal: review recent advances in the field of Computational Argumentation and outline the challenging research questions for the ACL community that naturally arise when trying to model human argumentation.
[<a href="http://acl2016tutorial.arg.tech/index.php/tutorial-materials/" title="NLP Approaches to Computational Argumentation Material">slides</a>]
</p>
<a id="studienstiftung-2015"></a>
<p data-author="matthias hagen, martin potthast">
<a href="events/studienstiftung-la-colle-sur-loup-15/">Summer Academy "Who Wrote the Web?"</a> @ Studienstiftung des deutschen Volkes 2015<br>
Workshop "Who Wrote the Web?", organized by Matthias Hagen and Martin Potthast in 2015.
Goal: reproduce the top most influential approaches, and to share the resulting code base to foster future research and development in this area.
[<a href="https://github.com/search?q=%22who+wrote+the+web%22+user:pan-webis-de">code</a>]
[<a href="publications.html#potthast_2016b">paper</a>]
</p>
<a id="heidelberg-laureate-forum-2014"></a>
<p data-author="martin potthast">
Building a Research Group @ <a href="https://web.archive.org/web/20190904015308/https://www.heidelberg-laureate-forum.org/event_2014/" title="HLF 2014">HLF 2014</a><br>
HLF Workshop "Building a Successful Research Group", organized by Martin Potthast at the 2nd Heidelberg Laureate Forum in 2014.
Goal: discuss with young researchers and laureates about the challenges and best practices of building a research group, and gain insights into the question of whether building a research group is better for a scientific career than working alone.
[<a href="events/hlf-14/hlf14-research-group-workshop-abstract.pdf" title="Workshop abstract">abstract</a>]
[<a href="events/hlf-14/hlf14-research-group-workshop-slides.pdf" title="Workshop slides">slides</a>]
</p>
<a id="heidelberg-laureate-forum-2013"></a>
<p data-author="matthias hagen">
Balance @ <a href="https://web.archive.org/web/20190904015655/https://www.heidelberg-laureate-forum.org/event_2013/" title="HLF 2013">HLF 2013</a><br>
HLF Workshop "Balance", organized by Matthias Hagen at the 1st Heidelberg Laureate Forum in 2013.
Goal: discuss with young researchers and laureates about issues of maintaining a work-life balance as a successful scientist, and gain insights into the question of how to develop a research career <i>and</i> a growing family.
[<a href="events/hlf-13/hlf13-balance-workshop-abstract.pdf" title="Workshop abstract">abstract</a>]
[<a href="events/hlf-13/hlf13-balance-workshop-slides.pdf" title="Workshop slides">slides</a>]
</p>
<a id="wiqe-2010"></a>
<p data-author="benno stein">
<a href="events/wiqe-10" title="WIQE 2010">WIQE 2010</a><br>
PhD colloquium "Web Information and Quality Evaluation", organized by Paolo Rosso, Alberto Barrón-Cedeño, and Benno Stein 2010 in Valencia, Spain.
Funded by a Marie Curie Action under the Seventh Framework Program.
Goal: development of promising research directions related to robust methods for detecting low quality information, judging credibility and reliability, and separating contradicting facts or outdated information from valuable information assets.
</p>
</div>
<!-- SECTION Shared Tasks -->
<div class="webis-paragraphs">
<h2><a id="shared-tasks"></a>Shared Tasks</h2>
<a id="chat-2020"></a>
<p data-author="martin potthast, benno stein, matti wiegmann">
<a href="https://events.professor-x.de/dc-ecmlpkdd-2020/" title="Chat Analytics for Twitch">Chat Analytics for Twitch</a> @ <a href="https://ecmlpkdd2020.net/" title="ECML PKDD 2020">ECML PKDD 2020</a><br>
A shared task organized by Konstantin Kobe, Martin Potthast, Albin Zehe, Matti Wiegmann, Andreas Hotho, and Benno Stein.
Goal: predict a user's subscription status regarding Twitch channels they are interacting with.
Four teams participated in this task.
</p>
<a id="tldr-2021"></a>
<p data-author="shahbaz syed, wei-fan chen, matthias hagen, benno stein, henning wachsmuth, martin potthast">
<a href="events/tldr-21/" title="TL;DR Challenge 2021">TL;DR Challenge</a> @ INLG 2021<br>
A shared task organized by Shahbaz Syed, Wei-Fan Chen, Matthias Hagen, Benno Stein, Henning Wachsmuth, and Martin Potthast.
Goal: generate abstractive snippets of web pages given the query and the web content.
</p>
<a id="sameside-2019"></a>
<p data-author="khalid al-khatib, yamen ajjour, roxanne el baff, benno stein, henning wachsmuth">
<a href="https://webis.de/events/sameside-19/" title="Same Side Stance Classification">Same Side Stance Classification</a> @ <a href="https://argmining19.webis.de/" title="ArgMining 2019">ArgMining 2019</a><br>
A shared task organized by Yamen Ajjour, Khalid Al-Khatib, Philipp Cimiano, Roxanne El Baff, Basil Ell, Benno Stein, and Henning Wachsmuth.
Goal: given two arguments on a certain topic, decide whether or not the two arguments have the same stance.
Eleven teams participated in this task.
</p>
<a id="tldr-2019"></a>
<p data-author="nedim lipka, martin potthast, benno stein, shahbaz syed, michael völske">
<a href="events/tldr-19/" title="TL;DR Challenge">TL;DR Challenge</a> @ <a href="https://www.inlg2019.com/" title="INLG 2019">INLG 2019</a><br>
A shared task organized by Shahbaz Syed, Michael Völske, Nedim Lipka, Benno Stein, Hinrich Schütze, and Martin Potthast.
Goal: generate short summaries of social media posts using abstractive summarization technology.
The task was hosted on the Webis evaluation-as-a-service platform <a href="http://tira.io">TIRA</a>.
[<a href="publications.html#syed_2019">paper</a>]
</p>
<a id="mediaeval-2019"></a>
<p data-author="martin potthast">
<a href="http://www.multimediaeval.org/mediaeval2019/gamestory/" title="GameStory 2019 Shared Task">GameStory: E-Sport Match Summarization</a> @ <a href="http://www.multimediaeval.org/mediaeval2019/" title="MediaEval 2019">MediaEval 2019</a><br>
A shared task organized by the Mathias Lux, Michael Riegler, Duc-Tien Dang-Nguyen, Marcus Larson, Martin Potthast, and Pål Halvorsen.
Goal: synthesis of summaries of e-sports matches.
Twenty-six teams participated in this task.
</p>
<a id="semeval-2018"></a>
<p data-author="benno stein, henning wachsmuth">
<a href="https://competitions.codalab.org/competitions/17327" title="SemEval 2018 Task 12">Argument Reasoning Comprehension</a> @ <a href="http://alt.qcri.org/semeval2018/" title="SemEval 2018 Task 12">SemEval 2018</a><br>
A shared task organized by Ivan Habernal, Henning Wachsmuth, Iryna Gurevych, and Benno Stein, Webis.
Goal: analyze and better understand certain hidden mechanisms of reasoning.
Twenty-two teams participated in this task.
[<a href="publications.html#habernal_2018c">paper</a>]
</p>
<a id="mediaeval-2018"></a>
<p data-author="martin potthast">
<a href="http://www.multimediaeval.org/mediaeval2018/gamestory/" title="GameStory 2018 Shared Task">GameStory: E-sport Match Summarization</a> @ <a href="http://www.multimediaeval.org/mediaeval2018/" title="MediaEval 2018">MediaEval 2018</a><br>
A shared task organized by the Mathias Lux, Michael Riegler, Duc-Tien Dang-Nguyen, Marcus Larson, Martin Potthast, and Pål Halvorsen.
Goal: synthesis of summaries of e-sports matches.
Three teams participated in this task.
[<a href="publications.html#potthast_2018c">paper</a>]
</p>
<a id="conll-2018"></a>
<p data-author="martin potthast">
<a href="http://universaldependencies.org/conll18/" title="CoNLL 2018 Shared Task">Universal Dependencies</a> @ <a href="http://www.conll.org/2018" title="CoNLL 2018">CoNLL 2018</a><br>
A shared task organized by the Charles University, Uppsala University, University of Turku, Google, and Leipzig University.
Goal: learning syntactic dependency parsers, that take raw text as input, and that can work over many typologically different languages, even low-resource ones.
Twenty-six teams participated in this task.
The task was hosted on the Webis evaluation-as-a-service platform <a href="http://tira.io">TIRA</a>.
[<a href="publications.html#potthast_2018b">paper</a>]
</p>
<a id="wsdm-cup-2017"></a>
<p data-author="martin potthast">
<a href="http://www.wsdm-cup-2017.org/" title="WSDM Cup 2017">Knowledge Base Quality and Search</a> @ <a href="http://www.wsdm-conference.org/2017/" title="WSDM 2017">WSDM 2017</a><br>
Two shared tasks organized by Stefan Heindorf, Hannah Bast, and Martin Potthast.
Goal: (1) detect vandalism in Wikidata, and (2) compute relevance scores for triples from type-like relations.
Five teams participated in this task.
The task was hosted on the Webis evaluation-as-a-service platform <a href="http://tira.io">TIRA</a>.
[<a href="publications.html#potthast_2017a">paper</a>]
</p>
<a id="conll-2017"></a>
<p data-author="martin potthast, benno stein">
<a href="http://universaldependencies.org/conll17/" title="CoNLL 2017 Shared Task">Universal Dependencies</a> @ <a href="http://www.conll.org/2017" title="CoNLL 2017">CoNLL 2017</a><br>
A shared task organized by the Charles University, Uppsala University, University of Turku, Google, Bauhaus-Universität Weimar, Stanford University, Ohio State University, Bar-Ilan University, Open University of Israel, University of Cambridge, The Arctic University of Norway, Univerity of Oslo, Leipzig University, IBM Research, University of Tübingen, University of Hamburg, University of Geneva, University of Helsinki, University of Stuttgart, DFKI, and University of Saarland.
Goal: learning syntactic dependency parsers, that take raw text as input, and that can work over many typologically different languages, even low-resource ones.
Thirty-three teams participated in this task.
The task was hosted on the Webis evaluation-as-a-service platform <a href="http://tira.io">TIRA</a>.
[<a href="publications.html#potthast_2017c">paper</a>]
</p>
<a id="clickbait-challenge-2017"></a>
<p data-author="tim gollub, matthias hagen, martin potthast, benno stein" data-keywords="ethics">
<a href="https://webis.de/events/clickbait-challenge/" title="Clickbait Challenge">Clickbait Challenge</a> @ <a href="https://newsinitiative.withgoogle.com/dnifund/dni-projects/clickbait/" title="Google DNI 2017">Google DNI 2017</a><br>
Two shared tasks organized by Martin Potthast, Tim Gollub, Matthias Hagen, and Benno Stein. Goal: Detect teaser messages in social media that manipulate readers to click a link, namely clickbait. Thirteen teams participated in this task. The task was hosted on the Webis evaluation-as-a-service platform <a href="http://tira.io">TIRA</a>.
[<a href="publications.html#potthast_2018e">paper</a>]
</p>
<a id="conll-2016"></a>
<p data-author="martin potthast">
<a href="http://www.cs.brandeis.edu/~clp/conll16st/" title="CoNLL 2016 Shared Task">Multilingual Shallow Discourse Parsing</a> @ <a href="http://www.conll.org/2016" title="CoNLL 2016">CoNLL 2016</a><br>
A shared task organized by the Brandeis University, the National University of Singapore, Boulder Learning, Inc., and the University of Edinburgh.
Goal: extracting discourse relations from newswire text in the form of a discourse connective (explicit or implicit) taking two arguments (which can be clauses, sentences, or multi-sentence segments).
Twenty-three teams participated in this task.
The task was hosted on the Webis evaluation-as-a-service platform <a href="http://tira.io">TIRA</a>.
</p>
<a id="conll-2015"></a>
<p data-author="martin potthast">
<a href="http://www.cs.brandeis.edu/~clp/conll15st/" title="CoNLL 2015 Shared Task">Shallow Discourse Parsing</a> @ <a href="http://www.conll.org/2015" title="CoNLL 2015">CoNLL 2015</a><br>
A shared task organized by the Brandeis University, the National University of Singapore, Boulder Language Technologies, and the University of Wisconsin-Milwaukee.
Goal: extracting discourse relations from newswire text in the form of a discourse connective (explicit or implicit) taking two arguments (which can be clauses, sentences, or multi-sentence segments).
Sixteen teams participated in this task.
The task was hosted on the Webis evaluation-as-a-service platform <a href="http://tira.io">TIRA</a>.
</p>
<a id="scai-2021"></a>
<p data-author="svitlana vakulenko, johannes kiesel, maik fröbe">
<a href="https://scai.info/scai-qrecc-2021/" title="SCAI QReCC Shared Task 2021">SCAI QReCC Shared Task 2021</a><br>
Conversational Question Answering (QA) is one of the core applications for retrieval-based chatbots. In conversational QA, the task is to answer a series of contextually-dependent questions like they may occur in natural human-to-human conversations.
The task was hosted on the Webis evaluation-as-a-service platform <a href="http://tira.io">TIRA</a>.
</p>
<a id="scai-2022"></a>
<p data-author="svitlana vakulenko, maik fröbe">
<a href="https://scai.info/scai-qrecc-2022/" title="SCAI QReCC Shared Task 2022">SCAI QReCC Shared Task 2022</a><br>
Conversational Question Answering (QA) is one of the core applications for retrieval-based chatbots. In conversational QA, the task is to answer a series of contextually-dependent questions like they may occur in natural human-to-human conversations.
The task was hosted on the Webis evaluation-as-a-service platform <a href="http://tira.io">TIRA</a>.
</p>
</div>
<!-- SECTION PAN Research Network -->
<div class="webis-paragraphs">
<h2><a id="pan-research-network"></a>PAN Research Network on Digital Text Forensics</h2>
<a id="pan-2024-at-clef"></a>
<p data-keywords="shared task, authorship-analytics" data-author="benno stein, matti wiegmann">
<a href="https://pan.webis.de/clef24/pan24-web" title="PAN 2024">PAN</a> @ <a href="http://clef2024.clef-initiative.eu/" title="Cross-Language Evaluation Forum 2024">CLEF 2024</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2024) in Grenoble, France.<br>
[<a href="https://pan.webis.de/clef24/pan24-web/style-change-detection.html" title="Multi-Author Writing Style Analysis">style change detection</a>]
[<a href="https://pan.webis.de/clef24/pan24-web/text-detoxification.html" title="Multilingual Text Detoxification">multilingual text detoxification</a>]
[<a href="https://pan.webis.de/clef24/pan24-web/oppositional-thinking-analysis.html" title="Oppositional Thinking Analysis">oppositional thinking analysis</a>]
[<a href="https://pan.webis.de/clef24/pan24-web/generated-content-analysis.html" title="Voight-Kampff Generative AI Authorship Verification">generative ai authorship verification</a>]
</p>
<a id="pan-2023-at-clef"></a>
<p data-keywords="shared task, authorship-analytics, trigger-warning" data-author="benno stein, matti wiegmann, nikolay kolyada">
<a href="https://pan.webis.de/clef23/pan23-web" title="PAN 2023">PAN</a> @ <a href="http://clef2023.clef-initiative.eu/" title="Cross-Language Evaluation Forum 2023">CLEF 2023</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2023) in Thessaloniki, Greece.<br>
[<a href="https://pan.webis.de/clef23/pan23-web/author-identification.html" title="Cross-Discourse Type Authorship Verification">authorship verification</a>]
[<a href="https://pan.webis.de/clef23/pan23-web/author-profiling.html" title="Profiling Cryptocurrency Influencers with Few-shot Learning">profiling irony and stereotype spreaders on twitter</a>]
[<a href="https://pan.webis.de/clef23/pan23-web/style-change-detection.html" title="Multi-Author Writing Style Analysis">style change detection</a>]
[<a href="https://pan.webis.de/clef23/pan23-web/trigger-detection.html" title="Trigger Detection">trigger detection</a>]
</p>
<a id="pan-2023-at-semeval, clickbait-spoiling"></a>
<p data-author="maik fröbe, tim gollub, matthias hagen, martin potthast">
<a href="https://pan.webis.de/semeval23/pan23-web/clickbait-challenge.html" title="PAN;">PAN</a> @ <a href="https://semeval.github.io/SemEval2023/" title="SemEval 2023 Task 5">SemEval 2023</a><br>
In conjunction with the 17th International Workshop on Semantic Evaluation (SemEval 2023).<br>
[<a href="https://pan.webis.de/semeval23/pan23-web/clickbait-challenge.html" title="Clickbait Spoiling">clickbait spoiling</a>]
<a id="pan-2022-at-clef"></a>
<p data-keywords="shared task, authorship-analytics" data-author="benno stein, matti wiegmann, nikolay kolyada">
<a href="https://pan.webis.de/clef22/pan22-web" title="PAN 2022">PAN</a> @ <a href="http://clef2022.clef-initiative.eu/" title="Cross-Language Evaluation Forum 2022">CLEF 2022</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2022) in Bologna, Italy.<br>
[<a href="https://pan.webis.de/clef22/pan22-web/author-identification.html" title="Authorship Verification">authorship verification</a>]
[<a href="https://pan.webis.de/clef22/pan22-web/author-profiling.html" title="Profiling Irony and Stereotype Spreaders on Twitter (IROSTEREO)">profiling irony and stereotype spreaders on twitter</a>]
[<a href="https://pan.webis.de/clef22/pan22-web/style-change-detection.html" title="Style Change Detection">style change detection</a>]
</p>
<a id="pan-2021-at-clef"></a>
<p data-keywords="shared task, authorship-analytics" data-author="benno stein, matti wiegmann, nikolay kolyada">
<a href="https://pan.webis.de/clef21/pan21-web" title="PAN 2021">PAN</a> @ <a href="http://clef2021.clef-initiative.eu/" title="Cross-Language Evaluation Forum 2021">CLEF 2021</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2021) in Bucharest, Romania.<br>
[<a href="https://pan.webis.de/clef21/pan21-web/author-identification.html" title="Cross-domain Authorship Verification">cross-domain authorship verification</a>]
[<a href="https://pan.webis.de/clef21/pan21-web/author-profiling.html" title="Profiling Hate Speech Spreaders on Twitter">profiling hate speech spreaders on twitter</a>]
[<a href="https://pan.webis.de/clef21/pan21-web/style-change-detection.html" title="Style Change Detection">style change detection</a>]
</p>
<a id="pan-2020-at-clef"></a>
<p data-keywords="shared task, authorship-analytics" data-author="benno stein, matti wiegmann, nikolay kolyada">
<a href="https://pan.webis.de/clef20/pan20-web" title="PAN 2020">PAN</a> @ <a href="http://clef2020.clef-initiative.eu/" title="Cross-Language Evaluation Forum 2020">CLEF 2020</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2020) in Thessaloniki, Greece.<br>
[<a href="https://pan.webis.de/clef20/pan20-web/celebrity-profiling.html" title="Celebrity Profiling">celebrity profiling</a>]
[<a href="https://pan.webis.de/clef20/pan20-web/author-identification.html" title="Cross-domain Authorship Verification">cross-domain authorship verification</a>]
[<a href="https://pan.webis.de/clef20/pan20-web/author-profiling.html" title="Profiling Fake News Spreaders on Twitter">profiling fake news spreaders on twitter</a>]
[<a href="https://pan.webis.de/clef20/pan20-web/style-change-detection.html" title="Style Change Detection">style change detection</a>]
</p>
<a id="pan-2019-at-clef"></a>
<p data-keywords="shared task, authorship-analytics" data-author="benno stein, matti wiegmann">
<a href="https://pan.webis.de/clef19/pan19-web" title="PAN 2019">PAN</a> @ <a href="http://clef2019.clef-initiative.eu/" title="Cross-Language Evaluation Forum 2019">CLEF 2019</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2019) in Lugano, Switzerland.<br>
[<a href="https://pan.webis.de/clef19/pan19-web/author-profiling.html" title="Author Profiling Task">bots and gender profiling</a>]
[<a href="https://pan.webis.de/clef19/pan19-web/celebrity-profiling.html" title="Celebrity Profiling Task">celebrity profiling</a>]
[<a href="https://pan.webis.de/clef19/pan19-web/authorship-attribution.html" title="Cross-domain Authorship Attribution Task">cross-domain authorship attribution</a>]
[<a href="https://pan.webis.de/clef19/pan19-web/style-change-detection.html" title="Style Change Detection Task">style change detection</a>]
</p>
<a id="pan-2019-at-semeval"></a>
<p data-author="johannes kiesel, benno stein" data-keywords="shared task, ethics">
<a href="https://pan.webis.de/semeval19/semeval19-web" title="PAN 2019">PAN</a> @ <a href="http://alt.qcri.org/semeval2019/" title="SemEval 2019 Task 4">SemEval 2019</a><br>
In conjunction with FactMata Ltd. and the 13th Workshop on Semantic Evaluation (SemEval 2019).<br>
[<a href="https://pan.webis.de/semeval19/semeval19-web" title="Hyperpartisan News Detection">hyperpartisan news detection</a>]
</p>
<a id="pan-2018-at-clef"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task, authorship-analytics">
<a href="https://pan.webis.de/clef18/pan18-web" title="PAN 2018">PAN</a> @ <a href="http://clef2018.clef-initiative.eu/" title="Cross-Language Evaluation Forum 2018">CLEF 2018</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2018) in Avignon, France.<br>
[<a href="https://pan.webis.de/clef18/pan18-web/authorship-attribution.html" title="Author Identification Task">author identification</a>]
[<a href="https://pan.webis.de/clef18/pan18-web/author-profiling.html" title="Author Profiling Task">author profiling</a>]
[<a href="https://pan.webis.de/clef18/pan18-web/author-obfuscation.html" title="Author Obfuscation Task">author obfuscation</a>]
[<a href="https://pan.webis.de/clef18/pan18-web/obfuscation-evaluation.html" title="Obfuscation Evaluation Task">obfuscation evaluation</a>]
[<a href="https://pan.webis.de/clef18/pan18-web/style-change-detection.html" title="Style Change Detection Task">style change detection</a>]
</p>
<a id="pan-2017-at-clef"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task, authorship-analytics">
<a href="https://pan.webis.de/clef17/pan17-web" title="PAN 2017">PAN</a> @ <a href="http://clef2017.clef-initiative.eu/" title="Cross-Language Evaluation Forum 2017">CLEF 2017</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2017) in Dublin, Ireland.<br>
[<a href="https://pan.webis.de/clef17/pan17-web/author-profiling.html" title="Author Profiling Task">author profiling</a>]
[<a href="https://pan.webis.de/clef17/pan17-web/author-masking.html" title="Author Masking Task">author masking</a>]
[<a href="https://pan.webis.de/clef17/pan17-web/author-clustering.html" title="Author Clustering Task">author clustering</a>]
[<a href="https://pan.webis.de/clef17/pan17-web/obfuscation-evaluation.html" title="Obfuscation Evaluation Task">obfuscation evaluation</a>]
[<a href="https://pan.webis.de/clef17/pan17-web/style-change-detection.html" title="Style Change Detection Task">style change detection</a>]
</p>
<a id="pan-2016-at-clef"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task, authorship-analytics">
<a href="https://pan.webis.de/clef16/pan16-web" title="PAN 2016">PAN</a> @ <a href="http://clef2016.clef-initiative.eu/" title="Cross-Language Evaluation Forum 2016">CLEF 2016</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2016) in Évora, Portugal.<br>
[<a href="https://pan.webis.de/clef16/pan16-web/author-clustering.html" title="Author Clustering Task">author clustering</a>]
[<a href="https://pan.webis.de/clef16/pan16-web/author-diarization.html" title="Author Diarization Task">author diarization</a>]
[<a href="https://pan.webis.de/clef16/pan16-web/author-profiling.html" title="Author Profiling Task">author profiling</a>]
[<a href="https://pan.webis.de/clef16/pan16-web/author-masking.html" title="Author Masking Task">author masking</a>]
[<a href="https://pan.webis.de/clef16/pan16-web/obfuscation-evaluation.html" title="Obfuscation Evaluation Task">obfuscation evaluation</a>]
</p>
<a id="pan-2015-at-fire"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task, ethics">
<a href="https://pan.webis.de/fire15/pan15-web/index.html" title="Arabic Plagiarism Detection Task">PAN</a> @ <a href="http://fire.irsi.res.in/fire/2015/home" title="Forum for Information Retrieval Evaluation 2015">FIRE 2015</a><br>
In conjunction with the Information Retrieval Society of India and the Forum for Information Retrieval Evaluation (FIRE 2015) in Gandhinagar, India.<br>
[<a href="https://pan.webis.de/fire15/pan15-web/araplagdet.html" title="Arabic Plagiarism Detection Task">plagiarism detection</a>]
[<a href="https://pan.webis.de/fire15/pan15-web/clsoco.html" title="Cross-Language Detection of SOurce COde Re-use">source code reuse detection</a>]
</p>
<a id="pan-2015-at-clef"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task, authorship-analytics,ethics">
<a href="https://pan.webis.de/clef15/pan15-web" title="PAN 2015">PAN</a> @ <a href="http://clef2015.clef-initiative.eu" title="Cross-Language Evaluation Forum 2015">CLEF 2015</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2015) in Toulouse, France.<br>
[<a href="https://pan.webis.de/clef15/pan15-web/author-profiling.html" title="Author Profiling Task">author profiling</a>]
[<a href="https://pan.webis.de/clef15/pan15-web/authorship-verification.html" title="Authorship Verification Task">authorship verification</a>]
[<a href="https://pan.webis.de/clef15/pan15-web/source-retrieval.html" title="Source Retrieval Task">source retrieval</a>]
[<a href="https://pan.webis.de/clef15/pan15-web/text-alignment.html" title="Text Alignment Task">text alignment</a>]
</p>
<a id="pan-2014-at-fire"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task">
PAN @ <a href="https://web.archive.org/web/20170827203436/http://www.isical.ac.in/~fire/2014/" title="Forum for Information Retrieval Evaluation 2014">FIRE 2014</a><br>
In conjunction with the Information Retrieval Society of India and the Forum for Information Retrieval Evaluation (FIRE 2014) in Bagalore, India.<br>
[source code reuse detection]
</p>
<a id="pan-2014-at-clef"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task, authorship-analytics, ethics">
<a href="https://pan.webis.de/clef14/pan14-web" title="PAN 2014">PAN</a> @ <a href="http://clef2014.clef-initiative.eu/" title="Cross-Language Evaluation Forum 2014">CLEF 2014</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2014) in Sheffield, UK.<br>
[<a href="https://pan.webis.de/clef14/pan14-web/authorship-verification.html" title="Authorship Verification Task">authorship verification</a>]
[<a href="https://pan.webis.de/clef14/pan14-web/author-profiling.html" title="Author Profiling Task">author profiling</a>]
[<a href="https://pan.webis.de/clef14/pan14-web/source-retrieval.html" title="Source Retrieval Task">source retrieval</a>]
[<a href="https://pan.webis.de/clef14/pan14-web/text-alignment.html" title="Text Alignment Task">text alignment</a>]
</p>
<p>
PAN @ <a href="https://web.archive.org/web/20170826020559/http://www.isical.ac.in/~fire/2013/" title="Forum for Information Retrieval Evaluation 2013">FIRE 2013</a><br>
In conjunction with the Information Retrieval Society of India and the Forum for Information Retrieval Evaluation (FIRE 2013) in New Delhi, India.<br>
[news story search]
</p>
<a id="pan-2013-at-clef"></a>
<p data-author="tim gollub, martin potthast, benno stein" data-keywords="shared task, authorship-analytics, ethics" >
<a href="https://pan.webis.de/clef13/pan13-web" title="PAN 2013">PAN</a> @ <a href="http://clef2013.clef-initiative.eu" title="Cross-Language Evaluation Forum 2013">CLEF 2013</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2013) in Valencia, Spain.<br>
[<a href="https://pan.webis.de/clef13/pan13-web/authorship-verification.html" title="Authorship Verification Task">author verification</a>]
[<a href="https://pan.webis.de/clef13/pan13-web/author-profiling.html" title="Author Profiling Task">author profiling</a>]
[<a href="https://pan.webis.de/clef13/pan13-web/source-retrieval.html" title="Source Retrieval Task">source retrieval</a>]
[<a href="https://pan.webis.de/clef13/pan13-web/text-alignment.html" title="Text Alignment Task">text alignment</a>]
</p>
<a id="pan-2012-at-fire"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task">
PAN @ <a href="https://web.archive.org/web/20171010203948/http://www.isical.ac.in/~fire/2012/" title="Forum for Information Retrieval Evaluation 2012">FIRE 2012</a><br>
In conjunction with the Information Retrieval Society of India and the Forum for Information Retrieval Evaluation (FIRE 2012) in Kolkata, India.<br>
[news story search]
</p>
<a id="pan-2012-at-clef"></a>
<p data-author="tim gollub, martin potthast, benno stein" data-keywords="shared task, authorship-analytics, ethics">
<a href="https://pan.webis.de/clef12/pan12-web" title="PAN 2012">PAN</a> @ <a href="http://clef2012.clef-initiative.eu" title="Cross-Language Evaluation Forum 2012">CLEF 2012</a><br>
In conjunction with the Conference and Labs of the Evaluation Forum (CLEF 2012) in Rome, Italy.<br>
[<a href="https://pan.webis.de/clef12/pan12-web/authorship-attribution.html" title="Authorship Attribution Task">authorship attribution</a>]
[<a href="https://pan.webis.de/clef12/pan12-web/sexual-predator-identification.html" title="Sexual Predator Identification Task">sexual predator identification</a>]
[<a href="https://pan.webis.de/clef12/pan12-web/source-retrieval.html" title="Source Retrieval Task">source retrieval</a>]
[<a href="https://pan.webis.de/clef12/pan12-web/text-alignment.html" title="Text Alignment Task">text alignment</a>]
[<a href="https://pan.webis.de/clef12/pan12-web/wikipedia-quality-flaw-prediction.html" title="Wikipedia Quality Flaw Prediction Task">wikipedia quality flaw prediction</a>]
</p>
<a id="pan-2011-at-fire"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task">
<a href="events/panfire-11" title="PAN FIRE-11">PAN</a> @ <a href="https://web.archive.org/web/20171022110946/https://www.isical.ac.in/~fire/2011/" title="Forum for Information Retrieval Evaluation 2011">FIRE 2011</a><br>
In conjunction with the Information Retrieval Society of India and the Forum for Information Retrieval Evaluation (FIRE 2011) in Bombay, India.<br>
[<a href="events/panfire-11" title="Cross-Language Indian Text Reuse Task">plagiarism detection</a>]
</p>
<a id="pan-2011-at-clef"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task, authorship-analytics, ethics">
<a href="https://pan.webis.de/clef11/pan11-web" title="PAN 2011">PAN</a> @ <a href="http://clef2011.clef-initiative.eu" title="Cross-Language Evaluation Forum 2011">CLEF 2011</a><br>
In conjunction with the Conference on Multilingual and Multimodal Information Access Evaluation (CLEF 2011) in Amsterdam, Netherlands.<br>
[<a href="https://pan.webis.de/clef11/pan11-web/authorship-attribution.html" title="Authorship Attribution Task">authorship attribution</a>]
[<a href="https://pan.webis.de/clef11/pan11-web/external-plagiarism-detection.html" title="External Plagiarism Detection Task">external plagiarism detection</a>]
[<a href="https://pan.webis.de/clef11/pan11-web/intrinsic-plagiarism-detection.html" title="Intrinsic Plagiarism Detection Task">intrinsic plagiarism detection</a>]
[<a href="https://pan.webis.de/clef11/pan11-web/wikipedia-vandalism-detection.html" title="Wikipedia Vandalism Detection Task">wikipedia vandalism detection</a>]
</p>
<a id="pan-2010-at-clef"></a>
<p data-author="martin potthast, benno stein" data-keywords="shared task, ethics">